2020-02-08T17:58:56.217 INFO:root:teuthology version: 1.0.0-ee19bca 2020-02-08T17:58:56.217 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.D0Xlt1.tmp -- --verbose --lock --description rados/standalone/{supported-random-distro$/{rhel_8.yaml} workloads/scrub.yaml} --name sage-2020-02-08_17:26:32-rados-wip-sage2-testing-2020-02-08-0831-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-02-08_17:26:32-rados-wip-sage2-testing-2020-02-08-0831-distro-basic-smithi/4745664 2020-02-08T17:58:56.238 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-08T17:58:56.299 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2020-02-08_17:26:32-rados-wip-sage2-testing-2020-02-08-0831-distro-basic-smithi/4745664 branch: wip-sage2-testing-2020-02-08-0831 description: rados/standalone/{supported-random-distro$/{rhel_8.yaml} workloads/scrub.yaml} email: null first_in_suite: false job_id: '4745664' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2020-02-08_17:26:32-rados-wip-sage2-testing-2020-02-08-0831-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.1' overrides: admin_socket: branch: wip-sage2-testing-2020-02-08-0831 ceph: conf: mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: f366546002698478e7b1888bb3d9023bb85c3032 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: f366546002698478e7b1888bb3d9023bb85c3032 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-sage2-testing-2020-02-08-0831 sha1: f366546002698478e7b1888bb3d9023bb85c3032 owner: scheduled_sage@teuthology priority: 80 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: f366546002698478e7b1888bb3d9023bb85c3032 suite: rados suite_branch: wip-sage2-testing-2020-02-08-0831 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage2-testing-2020-02-08-0831/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: f366546002698478e7b1888bb3d9023bb85c3032 tasks: - install: null - workunit: basedir: qa/standalone clients: all: - scrub teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.17166 2020-02-08T17:58:56.299 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage2-testing-2020-02-08-0831/qa; will attempt to use it 2020-02-08T17:58:56.299 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage2-testing-2020-02-08-0831/qa/tasks 2020-02-08T17:58:56.299 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-08T17:58:56.301 INFO:teuthology.task.internal:Checking packages... 2020-02-08T17:58:56.314 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'f366546002698478e7b1888bb3d9023bb85c3032' 2020-02-08T17:58:56.315 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-08T17:58:56.315 INFO:teuthology.packaging:ref: None 2020-02-08T17:58:56.315 INFO:teuthology.packaging:tag: None 2020-02-08T17:58:56.315 INFO:teuthology.packaging:branch: wip-sage2-testing-2020-02-08-0831 2020-02-08T17:58:56.315 INFO:teuthology.packaging:sha1: f366546002698478e7b1888bb3d9023bb85c3032 2020-02-08T17:58:56.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sage2-testing-2020-02-08-0831 2020-02-08T17:58:56.471 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-405.gf366546 2020-02-08T17:58:56.471 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-08T17:58:56.594 INFO:teuthology.task.internal:no buildpackages task found 2020-02-08T17:58:56.594 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-08T17:58:56.648 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-08T17:58:56.648 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-08T17:58:56.778 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T17:59:06.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T17:59:16.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T17:59:26.838 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T17:59:36.862 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T17:59:46.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T17:59:56.906 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T18:00:06.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T18:00:16.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2020-02-08T18:00:26.953 DEBUG:teuthology.lock.ops:lock_many request: {'count': 1, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2020-02-08_17:26:32-rados-wip-sage2-testing-2020-02-08-0831-distro-basic-smithi/4745664', 'machine_type': 'smithi'} 2020-02-08T18:00:27.011 DEBUG:teuthology.lock.ops:locked ubuntu@smithi157.front.sepia.ceph.com 2020-02-08T18:00:27.041 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-08T18:00:27.236 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.1 2020-02-08T18:00:27.594 INFO:teuthology.orchestra.console:Power off smithi157 2020-02-08T18:00:27.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-08T18:00:27.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-08T18:00:31.650 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-08T18:00:35.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-08T18:00:35.975 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2020-02-08T18:00:36.076 INFO:teuthology.orchestra.console:Power on smithi157 2020-02-08T18:00:36.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-08T18:00:36.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-08T18:00:40.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-08T18:00:44.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-08T18:00:44.518 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2020-02-08T18:00:44.619 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2020-02-08T18:03:15.931 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:03:40.506 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:03:49.595 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:03:58.650 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:04:07.703 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:04:16.762 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:04:25.815 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:04:57.401 INFO:teuthology.orchestra.run.smithi157:> hostname 2020-02-08T18:04:57.835 INFO:teuthology.orchestra.run.smithi157.stdout:smithi076 2020-02-08T18:04:57.836 INFO:teuthology.orchestra.run.smithi157:> grep smithi076 /etc/hosts 2020-02-08T18:04:57.865 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2020-02-08T18:04:57.866 INFO:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2020-02-08T18:04:57.998 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi076/smithi157/g' /etc/hosts 2020-02-08T18:04:58.027 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.76/172.21.15.157/g' /etc/hosts 2020-02-08T18:04:58.094 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi076/smithi157/g' /etc/hostname 2020-02-08T18:04:58.168 INFO:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2020-02-08T18:04:58.235 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2020-02-08T18:04:58.236 DEBUG:teuthology.parallel:result is None 2020-02-08T18:04:58.382 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2020-02-08T18:04:58.383 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-08T18:04:58.405 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2020-02-08T18:04:58.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-08T18:04:58.406 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:04:58.476 INFO:teuthology.orchestra.run.smithi157:> true 2020-02-08T18:04:58.652 INFO:teuthology.orchestra.run.smithi157:> uname -m 2020-02-08T18:04:58.706 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2020-02-08T18:04:58.706 INFO:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2020-02-08T18:04:58.760 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2020-02-08T18:04:58.760 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.1 (Ootpa)" 2020-02-08T18:04:58.760 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2020-02-08T18:04:58.760 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2020-02-08T18:04:58.760 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.1" 2020-02-08T18:04:58.760 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:04:58.761 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-02-08T18:04:58.762 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-02-08T18:04:58.762 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-02-08T18:04:58.762 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-02-08T18:04:58.763 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2020-02-08T18:04:58.784 INFO:teuthology.task.internal.lock_machines:1 smithi machines locked this try, 1/1 locked so far 2020-02-08T18:04:58.802 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5BHoLkrBE4OOnRZK4f+KDshBOTOaBs+NrFgIuu9whFtam+KoUA+dYYifjUBeOxb4wPRJre1wX4Sw/nI2PSYvvjLtpj8UFoL3yd8ExwidH3fcdcrS+Ny2iEX2pNgC2JAXgLNduZQiZR+SAuClQ19KJuOHv0MYZ+qT+Nkc2ey2ZoxozKSzbwxHy9lNPL8p7d4HviELRwVOygmm6rJJ+LjQH9el7tnIhrW2/QWeHrPU7gmnU2U2cPaL9bw0NLRK1C5HUKG3UaUfzrTnU6krSAs+yRi0En/sJjdb0pMbMenT3kUuIhwlHHCdIw9FxrVnOsikOm2gggVkRZyuuqEq5s4QSmQ9FzKiAQ9zdU0NNwN1FXG9worWfaLzyVNRN1CO+zWz20vhkMOrao5dAGbLb1Lk46RJgIW1NDyRYP8LBnB9Bp2GcnF6SjKDa7+9s4iYHijuXIccW8Qt9goFA7sl24wsOZ3IDgrhMZ0wFhtfJm6go647FlnTO/xQgGgaA0cUp5mU= 2020-02-08T18:04:58.802 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-08T18:04:58.854 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-02-08T18:04:58.879 INFO:teuthology.task.internal:Saving configuration 2020-02-08T18:04:58.893 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-02-08T18:04:58.928 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-02-08T18:04:58.950 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-08 18:00:26.961308', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi157.front.sepia.ceph.com', u'os_version': u'8.1', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4ehSe/Ghwz6uuFNvdUhzECAJHfkIZwWFUbPkRRyTLHNdyVDtpcosm9NCN19xBDQXaT1Rs0S+Jcjp24qkEZgaw=', u'description': u'/home/teuthworker/archive/sage-2020-02-08_17:26:32-rados-wip-sage2-testing-2020-02-08-0831-distro-basic-smithi/4745664'} 2020-02-08T18:04:58.951 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-02-08T18:04:58.970 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2020-02-08T18:04:58.971 INFO:teuthology.run_tasks:Running task console_log... 2020-02-08T18:04:59.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-08T18:04:59.141 INFO:teuthology.run_tasks:Running task internal.connect... 2020-02-08T18:04:59.159 INFO:teuthology.task.internal:Opening connections... 2020-02-08T18:04:59.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2020-02-08T18:04:59.160 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:04:59.231 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-02-08T18:04:59.243 INFO:teuthology.orchestra.run.smithi157:> uname -m 2020-02-08T18:04:59.417 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2020-02-08T18:04:59.418 INFO:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2020-02-08T18:04:59.471 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2020-02-08T18:04:59.472 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.1 (Ootpa)" 2020-02-08T18:04:59.472 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2020-02-08T18:04:59.472 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2020-02-08T18:04:59.472 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.1" 2020-02-08T18:04:59.472 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.1 (Ootpa)" 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.1:GA" 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:04:59.473 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-02-08T18:04:59.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.1 2020-02-08T18:04:59.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-02-08T18:04:59.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.1" 2020-02-08T18:04:59.474 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2020-02-08T18:04:59.493 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-02-08T18:04:59.526 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-02-08T18:04:59.539 INFO:teuthology.task.internal:Checking for old test directory... 2020-02-08T18:04:59.539 INFO:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2020-02-08T18:04:59.553 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-02-08T18:04:59.566 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-02-08T18:04:59.566 INFO:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2020-02-08T18:04:59.610 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-02-08T18:04:59.640 INFO:teuthology.run_tasks:Running task kernel... 2020-02-08T18:04:59.658 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}} 2020-02-08T18:04:59.658 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-02-08T18:04:59.658 INFO:teuthology.orchestra.run.smithi157:> uname -r 2020-02-08T18:04:59.672 INFO:teuthology.orchestra.run.smithi157.stdout:4.18.0-147.el8.x86_64 2020-02-08T18:04:59.673 INFO:teuthology.task.kernel:Running kernel on smithi157: 4.18.0-147.el8.x86_64 2020-02-08T18:04:59.673 INFO:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2020-02-08T18:05:01.467 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:05:01.468 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2020-02-08T18:05:01.611 INFO:teuthology.orchestra.run.smithi157.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-02-08T18:05:03.604 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 8 - x86_64 19 kB/s | 19 kB 00:00 2020-02-08T18:05:04.344 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 8 - x86_64 8.3 MB/s | 5.6 MB 00:00 2020-02-08T18:05:05.888 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:01 ago on Sat 08 Feb 2020 06:05:04 PM UTC. 2020-02-08T18:05:06.834 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-08T18:05:06.981 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:05:06.988 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:05:06.989 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:05:07.203 INFO:teuthology.orchestra.run.smithi157:> echo no | sudo yum reinstall kernel || true 2020-02-08T18:05:07.544 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:05:07.545 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2020-02-08T18:05:07.627 INFO:teuthology.orchestra.run.smithi157.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-02-08T18:05:07.746 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:03 ago on Sat 08 Feb 2020 06:05:04 PM UTC. 2020-02-08T18:05:08.055 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-02-08T18:05:08.125 INFO:teuthology.orchestra.run.smithi157.stderr:Error: No packages marked for reinstall. 2020-02-08T18:05:08.196 INFO:teuthology.orchestra.run.smithi157:> sudo yum reinstall -y kernel || true 2020-02-08T18:05:08.534 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:05:08.534 INFO:teuthology.orchestra.run.smithi157.stdout:Unable to read consumer identity 2020-02-08T18:05:08.605 INFO:teuthology.orchestra.run.smithi157.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-02-08T18:05:08.721 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:04 ago on Sat 08 Feb 2020 06:05:04 PM UTC. 2020-02-08T18:05:08.828 INFO:teuthology.orchestra.run.smithi157.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-02-08T18:05:08.871 INFO:teuthology.orchestra.run.smithi157.stderr:Error: No packages marked for reinstall. 2020-02-08T18:05:08.931 INFO:teuthology.orchestra.run.smithi157:> rpm -q kernel --last | head -n 1 2020-02-08T18:05:09.005 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-4.18.0-147.el8.x86_64 Fri 08 Nov 2019 07:28:24 PM UTC 2020-02-08T18:05:09.006 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-08T18:05:09.007 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-02-08T18:05:09.007 INFO:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-08T18:05:09.045 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2020-02-08T18:05:09.057 INFO:teuthology.run_tasks:Running task internal.base... 2020-02-08T18:05:09.067 INFO:teuthology.task.internal:Creating test directory... 2020-02-08T18:05:09.067 INFO:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-08T18:05:09.110 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-02-08T18:05:09.124 INFO:teuthology.run_tasks:Running task internal.archive... 2020-02-08T18:05:09.155 INFO:teuthology.task.internal:Creating archive directory... 2020-02-08T18:05:09.155 INFO:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-08T18:05:09.210 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-02-08T18:05:09.219 INFO:teuthology.task.internal:Enabling coredump saving... 2020-02-08T18:05:09.220 INFO:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-08T18:05:09.277 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:05:09.290 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:05:09.292 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-02-08T18:05:09.307 INFO:teuthology.task.internal:Configuring sudo... 2020-02-08T18:05:09.307 INFO:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-08T18:05:09.359 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-02-08T18:05:09.374 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-02-08T18:05:09.375 INFO:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-08T18:05:09.413 INFO:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-08T18:05:09.485 INFO:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-08T18:05:09.549 INFO:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-08T18:05:09.624 INFO:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-08T18:05:09.673 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-08T18:05:09.758 INFO:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2020-02-08T18:05:09.856 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-08T18:05:10.335 INFO:teuthology.run_tasks:Running task internal.timer... 2020-02-08T18:05:10.363 INFO:teuthology.task.internal:Starting timer... 2020-02-08T18:05:10.363 INFO:teuthology.run_tasks:Running task pcp... 2020-02-08T18:05:10.946 INFO:teuthology.run_tasks:Running task selinux... 2020-02-08T18:05:11.081 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-02-08T18:05:11.081 INFO:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2020-02-08T18:05:11.132 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: [ OK ] 2020-02-08T18:05:11.133 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-02-08T18:05:11.133 INFO:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2020-02-08T18:05:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2020-02-08T18:05:11.157 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2020-02-08T18:05:11.157 INFO:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-08T18:05:11.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-08T18:05:11.225 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-02-08T18:05:11.225 INFO:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2020-02-08T18:05:11.293 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-02-08T18:05:11.309 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-02-08T18:05:11.317 INFO:teuthology.repo_utils:Fetching master from origin 2020-02-08T18:05:11.533 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-02-08T18:05:11.549 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-02-08T18:05:11.553 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-02-08T18:05:11.917 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-02-08T18:05:13.046 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-02-08T18:05:15.816 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-02-08T18:05:15.842 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:15 +0000 (0:00:00.068) 0:00:00.068 ***** 2020-02-08T18:05:18.393 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi157.front.sepia.ceph.com] 2020-02-08T18:05:18.510 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:18 +0000 (0:00:02.668) 0:00:02.736 ***** 2020-02-08T18:05:18.852 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-08T18:05:18.891 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:18 +0000 (0:00:00.381) 0:00:03.118 ***** 2020-02-08T18:05:19.483 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-02-08T18:05:19.484 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-08T18:05:19.528 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:19 +0000 (0:00:00.636) 0:00:03.755 ***** 2020-02-08T18:05:19.562 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-02-08T18:05:19.563 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:19.612 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:19 +0000 (0:00:00.084) 0:00:03.839 ***** 2020-02-08T18:05:20.030 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-08T18:05:20.079 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:20 +0000 (0:00:00.466) 0:00:04.306 ***** 2020-02-08T18:05:20.080 INFO:teuthology.task.ansible.out: 2020-02-08T18:05:21.099 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-02-08T18:05:21.099 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "state": "file", "uid": 0} 2020-02-08T18:05:21.145 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:21 +0000 (0:00:01.065) 0:00:05.371 ***** 2020-02-08T18:05:21.729 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-02-08T18:05:21.730 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-02-08T18:05:21.731 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-08T18:05:21.834 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-02-08T18:05:21.839 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-02-08T18:05:22.014 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:22 +0000 (0:00:00.868) 0:00:06.240 ***** 2020-02-08T18:05:22.670 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi157.front.sepia.ceph.com] 2020-02-08T18:05:22.751 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-02-08T18:05:22.752 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:22 +0000 (0:00:00.737) 0:00:06.978 ***** 2020-02-08T18:05:23.290 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-02-08T18:05:23.290 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.223750", "end": "2020-02-08 18:05:23.264185", "rc": 0, "start": "2020-02-08 18:05:23.040435", "stderr": "", "stderr_lines": [], "stdout": "4cb88aebda35cf4cd833b3c781b994ccdb68e14a", "stdout_lines": ["4cb88aebda35cf4cd833b3c781b994ccdb68e14a"]} 2020-02-08T18:05:23.333 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.581) 0:00:07.559 ***** 2020-02-08T18:05:23.535 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-02-08T18:05:23.537 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009017", "end": "2020-02-08 18:05:23.513204", "failed_when_result": false, "rc": 0, "start": "2020-02-08 18:05:23.504187", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2020-02-08T18:05:23.576 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.243) 0:00:07.803 ***** 2020-02-08T18:05:23.602 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-02-08T18:05:23.603 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:23.645 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.069) 0:00:07.872 ***** 2020-02-08T18:05:23.692 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-02-08T18:05:23.694 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:23.735 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.089) 0:00:07.962 ***** 2020-02-08T18:05:23.772 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-02-08T18:05:23.773 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:23.809 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.073) 0:00:08.036 ***** 2020-02-08T18:05:23.835 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-02-08T18:05:23.836 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:23.873 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.063) 0:00:08.099 ***** 2020-02-08T18:05:23.896 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:23.934 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:23 +0000 (0:00:00.061) 0:00:08.161 ***** 2020-02-08T18:05:24.134 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-02-08T18:05:24.135 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-08T18:05:24.175 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:24 +0000 (0:00:00.240) 0:00:08.402 ***** 2020-02-08T18:05:24.433 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-08T18:05:24.434 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-02-08T18:05:24.642 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-02-08T18:05:24.849 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-02-08T18:05:25.048 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-02-08T18:05:25.258 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-02-08T18:05:25.466 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-02-08T18:05:25.667 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-02-08T18:05:25.867 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-02-08T18:05:26.070 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-02-08T18:05:26.267 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-02-08T18:05:26.482 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-02-08T18:05:26.694 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-02-08T18:05:26.889 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-02-08T18:05:27.092 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-02-08T18:05:27.291 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-02-08T18:05:27.491 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-02-08T18:05:27.698 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-02-08T18:05:27.907 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-02-08T18:05:28.108 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-02-08T18:05:28.308 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-02-08T18:05:28.496 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-02-08T18:05:28.694 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-02-08T18:05:28.905 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-02-08T18:05:29.104 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-02-08T18:05:29.308 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-02-08T18:05:29.507 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-02-08T18:05:29.717 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-02-08T18:05:29.905 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-02-08T18:05:30.112 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-02-08T18:05:30.298 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-02-08T18:05:30.506 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-02-08T18:05:30.707 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-02-08T18:05:30.915 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-02-08T18:05:31.122 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-02-08T18:05:31.318 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-02-08T18:05:31.535 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-02-08T18:05:31.735 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-02-08T18:05:31.930 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-02-08T18:05:32.137 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-02-08T18:05:32.325 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-02-08T18:05:32.533 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-02-08T18:05:32.730 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-02-08T18:05:32.938 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-02-08T18:05:33.145 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-02-08T18:05:33.352 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-02-08T18:05:34.028 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-02-08T18:05:34.179 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-02-08T18:05:34.373 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-02-08T18:05:34.577 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-02-08T18:05:34.790 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-02-08T18:05:34.989 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-02-08T18:05:35.198 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-02-08T18:05:35.395 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-02-08T18:05:35.605 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-02-08T18:05:35.826 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-02-08T18:05:36.035 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-02-08T18:05:36.246 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-02-08T18:05:36.455 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-02-08T18:05:36.659 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-02-08T18:05:36.869 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-02-08T18:05:37.071 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-02-08T18:05:37.278 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-02-08T18:05:37.488 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-02-08T18:05:37.690 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-02-08T18:05:37.907 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-02-08T18:05:38.106 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-02-08T18:05:38.309 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-02-08T18:05:38.506 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-02-08T18:05:38.715 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-02-08T18:05:38.904 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-02-08T18:05:39.103 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-02-08T18:05:39.312 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-02-08T18:05:39.519 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-02-08T18:05:39.719 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-02-08T18:05:39.927 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-02-08T18:05:40.125 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-02-08T18:05:40.326 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-02-08T18:05:40.533 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-02-08T18:05:40.741 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-02-08T18:05:40.938 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-02-08T18:05:41.159 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-02-08T18:05:41.370 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-02-08T18:05:41.573 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-02-08T18:05:41.789 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-02-08T18:05:41.982 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-02-08T18:05:42.182 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-02-08T18:05:42.385 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-02-08T18:05:42.595 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-02-08T18:05:42.796 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-02-08T18:05:43.025 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-02-08T18:05:43.223 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-02-08T18:05:43.424 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-02-08T18:05:43.632 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-02-08T18:05:43.832 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-02-08T18:05:44.040 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-02-08T18:05:44.246 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-02-08T18:05:44.441 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-02-08T18:05:44.636 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-02-08T18:05:44.846 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-02-08T18:05:45.038 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-02-08T18:05:45.242 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-02-08T18:05:46.695 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-02-08T18:05:47.830 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "name": "toabctl", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-02-08T18:05:49.026 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2020-02-08T18:05:50.186 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "name": "xiubli", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2020-02-08T18:05:51.318 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "name": "jafaj", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2020-02-08T18:05:52.490 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "name": "jschmid", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2020-02-08T18:05:53.662 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "name": "kachau", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2020-02-08T18:05:53.828 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:53 +0000 (0:00:29.652) 0:00:38.055 ***** 2020-02-08T18:05:53.866 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-08T18:05:53.926 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:53 +0000 (0:00:00.076) 0:00:38.132 ***** 2020-02-08T18:05:53.975 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-08T18:05:53.980 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ss 2020-02-08T18:05:53.989 INFO:teuthology.task.ansible.out:h-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN 2020-02-08T18:05:53.990 INFO:teuthology.task.ansible.out:2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499ea 2020-02-08T18:05:53.992 INFO:teuthology.task.ansible.out:f767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d 2020-02-08T18:05:53.995 INFO:teuthology.task.ansible.out:85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d 2020-02-08T18:05:53.996 INFO:teuthology.task.ansible.out:86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868" 2020-02-08T18:05:53.998 INFO:teuthology.task.ansible.out:}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad 2020-02-08T18:05:53.999 INFO:teuthology.task.ansible.out:7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280 2020-02-08T18:05:54.000 INFO:teuthology.task.ansible.out:b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029cc 2020-02-08T18:05:54.000 INFO:teuthology.task.ansible.out:dc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkr 2020-02-08T18:05:54.002 INFO:teuthology.task.ansible.out:Q 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": 2020-02-08T18:05:54.003 INFO:teuthology.task.ansible.out: "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}]}, "changed": false} 2020-02-08T18:05:54.051 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:54 +0000 (0:00:00.145) 0:00:38.277 ***** 2020-02-08T18:05:55.154 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi157.front.sepia.ceph.com -> localhost] => {"after": "4cb88aebda35cf4cd833b3c781b994ccdb68e14a", "attempts": 1, "before": "4cb88aebda35cf4cd833b3c781b994ccdb68e14a", "changed": false, "remote_url_changed": false} 2020-02-08T18:05:55.202 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:05:55 +0000 (0:00:01.151) 0:00:39.429 ***** 2020-02-08T18:05:55.569 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-08T18:05:55.570 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-02-08T18:05:55.570 INFO:teuthology.task.ansible.out: 2020-02-08T18:05:55.859 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-02-08T18:05:56.160 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-02-08T18:05:56.449 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2020-02-08T18:05:56.454 INFO:teuthology.task.ansible.out:lidate_certs": true} 2020-02-08T18:05:56.749 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-02-08T18:05:57.075 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2020-02-08T18:05:57.077 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-02-08T18:05:57.359 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-02-08T18:05:57.641 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-02-08T18:05:57.653 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:57.982 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2020-02-08T18:05:57.983 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-02-08T18:05:57.992 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:58.003 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:58.015 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:05:58.331 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-02-08T18:05:58.657 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2020-02-08T18:05:58.659 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-02-08T18:05:58.959 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-02-08T18:05:59.247 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-02-08T18:05:59.530 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2020-02-08T18:05:59.832 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-02-08T18:06:00.126 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-02-08T18:06:00.427 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-02-08T18:06:00.710 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2020-02-08T18:06:00.712 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-02-08T18:06:01.013 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2020-02-08T18:06:01.014 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-02-08T18:06:01.302 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-02-08T18:06:01.603 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-02-08T18:06:01.893 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2020-02-08T18:06:01.895 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-02-08T18:06:02.196 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-02-08T18:06:02.488 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-02-08T18:06:02.779 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-02-08T18:06:03.074 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-02-08T18:06:03.357 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-02-08T18:06:03.642 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2020-02-08T18:06:03.643 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-02-08T18:06:03.933 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-02-08T18:06:04.212 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-02-08T18:06:04.512 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-02-08T18:06:04.800 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-02-08T18:06:05.082 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-02-08T18:06:05.382 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-02-08T18:06:05.670 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-02-08T18:06:05.965 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-02-08T18:06:06.267 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-02-08T18:06:06.569 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2020-02-08T18:06:06.571 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-02-08T18:06:06.862 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2020-02-08T18:06:06.863 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-02-08T18:06:07.143 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-02-08T18:06:07.434 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-02-08T18:06:07.731 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-02-08T18:06:08.026 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2020-02-08T18:06:08.027 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-02-08T18:06:08.324 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2020-02-08T18:06:08.325 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2020-02-08T18:06:08.326 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-02-08T18:06:08.616 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-02-08T18:06:08.910 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-02-08T18:06:09.199 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-02-08T18:06:09.504 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-02-08T18:06:09.791 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-02-08T18:06:10.083 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-02-08T18:06:10.359 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-02-08T18:06:10.651 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-02-08T18:06:10.945 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2020-02-08T18:06:10.947 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2020-02-08T18:06:11.219 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-02-08T18:06:11.509 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-02-08T18:06:11.806 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2020-02-08T18:06:11.808 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-02-08T18:06:12.101 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-02-08T18:06:12.395 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-02-08T18:06:12.699 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-02-08T18:06:13.016 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-02-08T18:06:13.323 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-02-08T18:06:13.615 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-02-08T18:06:13.896 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-02-08T18:06:14.184 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-02-08T18:06:14.465 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-02-08T18:06:14.768 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-02-08T18:06:15.072 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-02-08T18:06:15.367 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-02-08T18:06:15.668 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-02-08T18:06:15.954 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-02-08T18:06:16.235 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-02-08T18:06:16.522 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-02-08T18:06:16.806 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-02-08T18:06:17.096 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-02-08T18:06:17.376 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-02-08T18:06:17.675 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-02-08T18:06:18.030 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-02-08T18:06:18.455 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-02-08T18:06:18.756 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-02-08T18:06:19.055 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-02-08T18:06:19.324 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-02-08T18:06:19.614 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2020-02-08T18:06:19.615 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-02-08T18:06:19.893 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2020-02-08T18:06:19.894 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-02-08T18:06:20.176 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-02-08T18:06:20.468 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-02-08T18:06:20.749 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-02-08T18:06:21.048 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-02-08T18:06:21.328 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-02-08T18:06:21.614 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-02-08T18:06:21.889 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-02-08T18:06:22.177 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-02-08T18:06:22.467 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-02-08T18:06:22.748 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-02-08T18:06:23.059 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-02-08T18:06:23.329 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-02-08T18:06:23.610 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-02-08T18:06:23.901 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-02-08T18:06:24.183 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2020-02-08T18:06:24.184 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-02-08T18:06:24.464 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-02-08T18:06:24.747 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-02-08T18:06:25.030 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-02-08T18:06:25.323 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-02-08T18:06:25.615 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzVa77kg0qGGE3IpMZgSYJ+UwQiDEOg3Lji470V/sQ/R7g6/v7FZpaYqGn1wG3XeUp2gGACxNKLQfGV9EGU66NvfQYqn9A8dXRpTpZuGWN8EcKK98YrSAq0s0WzeiEzVT86RHzVHIqL6/Zn4B1p9sIeY9Hb+bfKOdtYkRBDoFELtiMRzHPFaiIJFnXl+EhH8wceYqXVNNvCuOUBMnOiDYLDtujvYdPt+ff7rvXuOzbwcAKoINFM1C4FtoUEYriKlsxJ2rr7AblfDm/WIrCZcqRBU4JcudtvZOtHhvN4uL6WgzuzuhIQFyePAeIHFUn6AiwKC/MApq7z1Qj+N3pN/Nz xiubli@fedora1", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-02-08T18:06:25.895 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-02-08T18:06:26.190 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-02-08T18:06:26.488 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHZ739LVtNJVfcdnwYl7dwvPpC96dHxSn7UlRIzvSbBid0B+pMxE9OZv0UlyvDe737oPZthZYrAaeicKHO9p5aQwbhhIGImvm85sd1YxiQC6h6LxebJ6iFbtzMaEQ9SJUJFvUtItc1nQ8aPpY0CkDFWbzNn6ib8AKGTfcA+wsg08eBUJNSKexebHQCLC2c3HlDmRnjSTitl72h5pSgq7vcynhCJDlkJg49YesmNhWm9QNjwih3ITRzzUC5GaQ4uODlOETRmf84J9FDX8fMaRdPl4cZwhfI8q+0T/74Qrg1J82Ska+O5DhhbzFEqBkchYpbgetTPkUNHRbfL/GlK+7/8BKiUW+Fo7NkTDVpVYBaQOQSZEWWiPq04NMLORJ1HiHo7HsT7WI/HcVbt19YWZf7VZgB06p8LAaZsZxLBO/eqtjebOLFmMoEa4UaAepBXKo8O2hddaHjb4WVrEN+bTRUexuyTlZVbeukUky3gI2MfQirP4stmci02OKuvUuP1sM= karan@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-02-08T18:06:26.590 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:26 +0000 (0:00:31.388) 0:01:10.817 ***** 2020-02-08T18:06:26.637 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-08T18:06:26.638 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.648 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.649 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.660 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.671 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.672 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.683 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.695 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:26.987 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-02-08T18:06:26.998 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.287 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2020-02-08T18:06:27.562 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-02-08T18:06:27.843 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-02-08T18:06:27.867 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.880 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.882 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.891 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.902 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.919 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.927 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.940 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.952 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.963 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.976 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.987 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:27.999 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.010 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.022 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.033 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.044 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.057 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.059 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.070 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.082 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.094 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.096 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.107 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.119 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.120 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.132 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.149 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.151 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.163 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.164 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.175 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.186 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.197 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.201 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.209 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.220 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.220 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.233 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.243 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.254 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.266 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.287 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.287 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.298 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.309 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.310 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.321 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.332 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.343 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.354 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.355 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.367 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.377 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.389 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.400 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.411 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.421 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.432 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.433 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.444 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.455 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.466 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.478 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.489 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.489 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.500 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.512 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.523 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.523 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.535 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.553 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.557 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.568 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.569 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.581 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.592 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.593 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.604 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.625 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.626 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.628 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.638 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.672 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.683 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.695 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.709 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.711 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.817 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:28 +0000 (0:00:02.224) 0:01:13.042 ***** 2020-02-08T18:06:28.844 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-02-08T18:06:28.846 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:28.892 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:28 +0000 (0:00:00.076) 0:01:13.118 ***** 2020-02-08T18:06:29.347 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi157.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-02-08T18:06:29.612 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-02-08T18:06:29.847 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-02-08T18:06:30.066 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-02-08T18:06:30.264 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-02-08T18:06:30.462 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-02-08T18:06:30.667 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-02-08T18:06:30.861 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-02-08T18:06:31.057 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-02-08T18:06:31.253 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-02-08T18:06:31.453 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-02-08T18:06:31.646 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-02-08T18:06:31.846 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-02-08T18:06:32.047 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-02-08T18:06:32.255 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-02-08T18:06:32.446 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-02-08T18:06:32.643 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-02-08T18:06:32.841 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-02-08T18:06:33.045 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-02-08T18:06:33.243 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-02-08T18:06:33.438 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-02-08T18:06:34.547 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2020-02-08T18:06:35.694 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2020-02-08T18:06:36.707 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2020-02-08T18:06:37.876 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2020-02-08T18:06:39.023 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2020-02-08T18:06:40.086 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2020-02-08T18:06:41.129 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2020-02-08T18:06:42.165 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2020-02-08T18:06:43.236 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2020-02-08T18:06:44.334 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2020-02-08T18:06:45.403 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2020-02-08T18:06:46.570 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2020-02-08T18:06:47.621 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adeza", "name": "adeza", "remove": false, "state": "absent"} 2020-02-08T18:06:47.829 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-02-08T18:06:48.026 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-02-08T18:06:48.216 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-02-08T18:06:48.414 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-02-08T18:06:48.627 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-02-08T18:06:48.825 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-02-08T18:06:49.028 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-02-08T18:06:50.049 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2020-02-08T18:06:50.126 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:50 +0000 (0:00:21.234) 0:01:34.353 ***** 2020-02-08T18:06:50.947 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "checksum": "35747edbadf7acceb11aeab8879c8e9234d34975", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c54ec7407566634645730139fa2b4dd9", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581185210.15-171294032837623/source", "state": "file", "uid": 0} 2020-02-08T18:06:50.989 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:50 +0000 (0:00:00.862) 0:01:35.216 ***** 2020-02-08T18:06:51.016 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-02-08T18:06:51.017 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => { "msg": "Host smithi157.front.sepia.ceph.com is running RedHat 8.1 (Ootpa)" } 2020-02-08T18:06:51.060 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.070) 0:01:35.287 ***** 2020-02-08T18:06:51.091 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-02-08T18:06:51.092 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-02-08T18:06:51.140 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.080) 0:01:35.367 ***** 2020-02-08T18:06:51.167 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-02-08T18:06:51.169 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:51.203 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.062) 0:01:35.430 ***** 2020-02-08T18:06:51.476 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-02-08T18:06:51.476 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.077945", "end": "2020-02-08 18:06:51.451255", "rc": 0, "start": "2020-02-08 18:06:51.373310", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-08T18:06:51.519 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.316) 0:01:35.746 ***** 2020-02-08T18:06:51.555 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-08T18:06:51.557 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:51.593 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.073) 0:01:35.820 ***** 2020-02-08T18:06:51.618 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-08T18:06:51.620 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:51.654 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.060) 0:01:35.881 ***** 2020-02-08T18:06:51.691 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-08T18:06:51.696 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:51.730 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.075) 0:01:35.956 ***** 2020-02-08T18:06:51.755 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-08T18:06:51.756 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:51.791 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.061) 0:01:36.018 ***** 2020-02-08T18:06:51.816 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-02-08T18:06:51.818 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:06:51.853 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.062) 0:01:36.080 ***** 2020-02-08T18:06:51.889 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-02-08T18:06:51.891 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-02-08T18:06:51.925 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:51 +0000 (0:00:00.071) 0:01:36.152 ***** 2020-02-08T18:06:51.971 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-08T18:06:51.972 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-08T18:06:52.009 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:52 +0000 (0:00:00.083) 0:01:36.235 ***** 2020-02-08T18:06:52.044 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-02-08T18:06:52.046 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-02-08T18:06:52.082 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:52 +0000 (0:00:00.072) 0:01:36.308 ***** 2020-02-08T18:06:53.508 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1581185213.38778-uz7ulv6k/katello-ca-consumer-latest.noarchp84e_crb.rpm"]} 2020-02-08T18:06:53.544 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:53 +0000 (0:00:01.463) 0:01:37.771 ***** 2020-02-08T18:06:54.497 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-02-08T18:06:54.501 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-02-08T18:06:54.547 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:54 +0000 (0:00:01.002) 0:01:38.774 ***** 2020-02-08T18:06:54.583 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-02-08T18:06:54.621 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:06:54 +0000 (0:00:00.073) 0:01:38.848 ***** 2020-02-08T18:07:03.510 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-08T18:07:03.551 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:03 +0000 (0:00:08.930) 0:01:47.778 ***** 2020-02-08T18:07:03.553 INFO:teuthology.task.ansible.out: 2020-02-08T18:07:03.589 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-02-08T18:07:03.591 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-02-08T18:07:03.632 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:03 +0000 (0:00:00.078) 0:01:47.857 ***** 2020-02-08T18:07:04.517 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-08T18:07:04.518 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.686174", "end": "2020-02-08 18:07:04.489071", "failed_when_result": false, "rc": 0, "start": "2020-02-08 18:07:03.802897", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} 2020-02-08T18:07:04.554 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:04 +0000 (0:00:00.924) 0:01:48.781 ***** 2020-02-08T18:07:04.581 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-02-08T18:07:04.582 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:04.619 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:04 +0000 (0:00:00.064) 0:01:48.845 ***** 2020-02-08T18:07:04.655 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-08T18:07:04.656 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:04.693 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:04 +0000 (0:00:00.074) 0:01:48.920 ***** 2020-02-08T18:07:04.719 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-08T18:07:04.720 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-08T18:07:04.757 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:04 +0000 (0:00:00.063) 0:01:48.984 ***** 2020-02-08T18:07:04.783 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-08T18:07:04.784 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:04.824 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:04 +0000 (0:00:00.066) 0:01:49.050 ***** 2020-02-08T18:07:14.397 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-02-08T18:07:14.399 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:09.374203", "end": "2020-02-08 18:07:14.376517", "rc": 0, "start": "2020-02-08 18:07:05.002314", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-02-08T18:07:14.437 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:14 +0000 (0:00:09.612) 0:01:58.663 ***** 2020-02-08T18:07:14.474 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-02-08T18:07:14.509 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:14 +0000 (0:00:00.072) 0:01:58.736 ***** 2020-02-08T18:07:14.544 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-08T18:07:14.546 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:14.582 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:14 +0000 (0:00:00.072) 0:01:58.808 ***** 2020-02-08T18:07:14.628 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-02-08T18:07:14.630 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-02-08T18:07:14.664 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:14 +0000 (0:00:00.082) 0:01:58.891 ***** 2020-02-08T18:07:14.700 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-08T18:07:14.702 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-02-08T18:07:14.737 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:14 +0000 (0:00:00.072) 0:01:58.963 ***** 2020-02-08T18:07:20.328 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-08T18:07:20.364 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:20 +0000 (0:00:05.627) 0:02:04.591 ***** 2020-02-08T18:07:26.577 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi157.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-baseos-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-baseos-rpms"], "delta": "0:00:05.971486", "end": "2020-02-08 18:07:26.545005", "item": "rhel-8-for-x86_64-baseos-rpms", "rc": 0, "start": "2020-02-08 18:07:20.573519", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system."]} 2020-02-08T18:07:32.244 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-appstream-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:05.474764", "end": "2020-02-08 18:07:32.217822", "item": "rhel-8-for-x86_64-appstream-rpms", "rc": 0, "start": "2020-02-08 18:07:26.743058", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-02-08T18:07:32.297 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:32 +0000 (0:00:11.933) 0:02:16.524 ***** 2020-02-08T18:07:32.507 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-02-08T18:07:32.545 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:32 +0000 (0:00:00.247) 0:02:16.771 ***** 2020-02-08T18:07:32.761 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-08T18:07:32.800 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:32 +0000 (0:00:00.255) 0:02:17.027 ***** 2020-02-08T18:07:33.367 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-08T18:07:33.368 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "md5sum": "a8fc4394319cef97573dd9cbb76e901f", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581185252.84-200093880978831/source", "state": "file", "uid": 0} 2020-02-08T18:07:33.881 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "md5sum": "28027cc3431fdd12cf0ab83482917668", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581185253.38-62690564677097/source", "state": "file", "uid": 0} 2020-02-08T18:07:33.921 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:33 +0000 (0:00:01.119) 0:02:18.147 ***** 2020-02-08T18:07:34.487 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-08T18:07:34.488 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "c0b17108eae19ce4e019023f4d971436", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581185253.96-65380118768803/source", "state": "file", "uid": 0} 2020-02-08T18:07:35.077 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "8ea2607820b97348115878813225ac00", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581185254.5-94527548622462/source", "state": "file", "uid": 0} 2020-02-08T18:07:35.116 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:35 +0000 (0:00:01.195) 0:02:19.343 ***** 2020-02-08T18:07:36.446 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-08T18:07:36.446 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-08T18:07:36.448 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:01.130045", "end": "2020-02-08 18:07:36.423487", "rc": 0, "start": "2020-02-08 18:07:35.293442", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\n82 files removed", "stdout_lines": ["Updating Subscription Management repositories.", "82 files removed"]} 2020-02-08T18:07:36.487 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:01.370) 0:02:20.714 ***** 2020-02-08T18:07:36.513 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-08T18:07:36.514 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.551 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.063) 0:02:20.778 ***** 2020-02-08T18:07:36.582 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.630 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.075) 0:02:20.853 ***** 2020-02-08T18:07:36.652 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-02-08T18:07:36.653 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.689 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.062) 0:02:20.916 ***** 2020-02-08T18:07:36.715 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-08T18:07:36.717 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.755 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.065) 0:02:20.982 ***** 2020-02-08T18:07:36.786 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-02-08T18:07:36.788 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.827 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.071) 0:02:21.054 ***** 2020-02-08T18:07:36.863 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-02-08T18:07:36.864 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.899 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.071) 0:02:21.126 ***** 2020-02-08T18:07:36.926 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:36.961 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:36 +0000 (0:00:00.062) 0:02:21.188 ***** 2020-02-08T18:07:36.994 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-02-08T18:07:36.996 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:37.030 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:37 +0000 (0:00:00.068) 0:02:21.257 ***** 2020-02-08T18:07:37.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.288063", "end": "2020-02-08 18:07:37.500317", "rc": 0, "start": "2020-02-08 18:07:37.212254", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:07:37.562 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:37 +0000 (0:00:00.530) 0:02:21.787 ***** 2020-02-08T18:07:50.788 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-02-08T18:07:50.789 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-workstation-1.17-9.el8.x86_64", "Installed: krb5-libs-1.17-9.el8.x86_64", "Installed: libkadm5-1.17-9.el8.x86_64", "Removed: krb5-libs-1.16.1-22.el8.x86_64", "Removed: krb5-workstation-1.16.1-22.el8.x86_64", "Removed: libkadm5-1.16.1-22.el8.x86_64"]} 2020-02-08T18:07:50.842 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:50 +0000 (0:00:13.281) 0:02:35.069 ***** 2020-02-08T18:07:50.875 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:50.915 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:50 +0000 (0:00:00.072) 0:02:35.142 ***** 2020-02-08T18:07:50.948 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:50.979 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:50 +0000 (0:00:00.064) 0:02:35.206 ***** 2020-02-08T18:07:51.006 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-02-08T18:07:51.007 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:51.045 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:51 +0000 (0:00:00.065) 0:02:35.272 ***** 2020-02-08T18:07:51.072 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-02-08T18:07:51.073 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:51.112 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:51 +0000 (0:00:00.067) 0:02:35.339 ***** 2020-02-08T18:07:51.597 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-08T18:07:51.635 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:51 +0000 (0:00:00.523) 0:02:35.862 ***** 2020-02-08T18:07:51.637 INFO:teuthology.task.ansible.out: 2020-02-08T18:07:53.527 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-08T18:07:53.565 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:53 +0000 (0:00:01.929) 0:02:37.792 ***** 2020-02-08T18:07:54.089 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-08T18:07:54.090 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-08T18:07:54.586 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-08T18:07:55.035 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-08T18:07:55.073 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:55 +0000 (0:00:01.508) 0:02:39.300 ***** 2020-02-08T18:07:55.266 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-08T18:07:55.267 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-08T18:07:55.311 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:55 +0000 (0:00:00.238) 0:02:39.538 ***** 2020-02-08T18:07:55.797 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi157.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-08T18:07:56.262 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-08T18:07:56.707 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-08T18:07:56.746 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:56 +0000 (0:00:01.434) 0:02:40.972 ***** 2020-02-08T18:07:56.772 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-02-08T18:07:56.773 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:56.809 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:56 +0000 (0:00:00.063) 0:02:41.036 ***** 2020-02-08T18:07:56.850 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-08T18:07:56.852 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-08T18:07:56.892 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:56 +0000 (0:00:00.082) 0:02:41.119 ***** 2020-02-08T18:07:57.097 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi157.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-08T18:07:57.130 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:57 +0000 (0:00:00.238) 0:02:41.357 ***** 2020-02-08T18:07:57.167 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-02-08T18:07:57.168 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-08T18:07:57.178 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-08T18:07:57.189 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-08T18:07:57.211 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-08T18:07:57.251 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:57 +0000 (0:00:00.121) 0:02:41.478 ***** 2020-02-08T18:07:59.122 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-02-08T18:07:59.123 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-08T18:07:59.165 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:59 +0000 (0:00:01.913) 0:02:43.392 ***** 2020-02-08T18:07:59.190 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-08T18:07:59.191 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:07:59.252 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:59 +0000 (0:00:00.086) 0:02:43.479 ***** 2020-02-08T18:07:59.955 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-02-08T18:07:59.956 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-08T18:07:59.997 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:07:59 +0000 (0:00:00.744) 0:02:44.223 ***** 2020-02-08T18:08:00.516 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-08T18:08:00.516 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-08T18:08:00.565 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:00 +0000 (0:00:00.567) 0:02:44.791 ***** 2020-02-08T18:08:00.590 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-08T18:08:00.594 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:08:00.635 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:00 +0000 (0:00:00.069) 0:02:44.861 ***** 2020-02-08T18:08:00.849 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-08T18:08:00.851 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-08T18:08:00.890 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:00 +0000 (0:00:00.255) 0:02:45.117 ***** 2020-02-08T18:08:01.124 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-02-08T18:08:01.125 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-08T18:08:01.182 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:01 +0000 (0:00:00.291) 0:02:45.408 ***** 2020-02-08T18:08:01.224 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:08:01.256 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:01 +0000 (0:00:00.074) 0:02:45.483 ***** 2020-02-08T18:08:01.748 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-02-08T18:08:01.750 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-08T18:08:01.808 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:01 +0000 (0:00:00.550) 0:02:46.034 ***** 2020-02-08T18:08:02.577 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-02-08T18:08:02.579 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-02-08 18:04:52 UTC", "ActiveEnterTimestampMonotonic": "13719987", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target nss-lookup.target time-sync.target var-run.mount systemd-journald.socket system.slice -.mount tmp.mount systemd-tmpfiles-setup.service network.target basic.target local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-02-08 18:04:52 UTC", "AssertTimestampMonotonic": "13719323", "Before": "multi-user.target plymouth-quit.service getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-02-08 18:04:52 UTC", "ConditionTimestampMonotonic": "13719321", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-02-08T18:08:02.581 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2390", "ExecMainStartTimestamp": "Sat 2020-02-08 18:04:52 UTC", "ExecMainStartTimestampMonotonic": "13719965", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Sat 2020-02-08 18:04:52 UTC] ; stop_time=[n/a] ; pid=2390 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-02-08 18:04:52 UTC", "InactiveExitTimestampMonotonic": "13719987", "InvocationID": "31aeb5652fb348b8ba3b81c3784a2ee9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-02-08T18:08:02.582 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2390", "MemoryAccounting": "yes", "MemoryCurrent": "1122304", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-02-08T18:08:02.584 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-02-08 18:04:52 UTC", "StateChangeTimestampMonotonic": "13719987", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-02-08 18:04:52 UTC", "WatchdogTimestampMonotonic": "13719986", "WatchdogUSec": "0"}} 2020-02-08T18:08:02.616 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:02 +0000 (0:00:00.809) 0:02:46.843 ***** 2020-02-08T18:08:02.808 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-08T18:08:02.809 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001786", "end": "2020-02-08 18:08:02.786665", "rc": 0, "start": "2020-02-08 18:08:02.784879", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-08T18:08:02.844 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:02 +0000 (0:00:00.228) 0:02:47.071 ***** 2020-02-08T18:08:10.180 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-02-08T18:08:10.182 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: policycoreutils-python-utils-2.9-3.el8_1.1.noarch", "Installed: python3-policycoreutils-2.9-3.el8_1.1.noarch", "Installed: policycoreutils-2.9-3.el8_1.1.x86_64", "Removed: policycoreutils-2.9-3.el8.x86_64", "Removed: python3-policycoreutils-2.9-3.el8.noarch", "Removed: policycoreutils-python-utils-2.9-3.el8.noarch"]} 2020-02-08T18:08:10.218 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:10 +0000 (0:00:07.374) 0:02:54.445 ***** 2020-02-08T18:08:12.161 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-02-08T18:08:12.162 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-08T18:08:12.218 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:12 +0000 (0:00:01.999) 0:02:56.445 ***** 2020-02-08T18:08:13.869 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-02-08T18:08:13.870 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-08T18:08:13.912 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:13 +0000 (0:00:01.693) 0:02:58.138 ***** 2020-02-08T18:08:30.198 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-02-08T18:08:30.200 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.091260", "end": "2020-02-08 18:08:30.177827", "failed_when_result": false, "rc": 0, "start": "2020-02-08 18:08:14.086567", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-08T18:08:30.247 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:30 +0000 (0:00:16.335) 0:03:14.474 ***** 2020-02-08T18:08:30.728 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-02-08T18:08:30.729 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-08T18:08:30.782 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:30 +0000 (0:00:00.534) 0:03:15.008 ***** 2020-02-08T18:08:31.009 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-02-08T18:08:31.009 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016297", "end": "2020-02-08 18:08:30.985779", "rc": 0, "start": "2020-02-08 18:08:30.969482", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:08:31.049 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:31 +0000 (0:00:00.267) 0:03:15.276 ***** 2020-02-08T18:08:31.245 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001746", "end": "2020-02-08 18:08:31.223561", "rc": 0, "start": "2020-02-08 18:08:31.221815", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:08:31.288 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:31 +0000 (0:00:00.238) 0:03:15.515 ***** 2020-02-08T18:08:47.525 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-02-08T18:08:47.527 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.042461", "end": "2020-02-08 18:08:47.505267", "rc": 0, "start": "2020-02-08 18:08:31.462806", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:08:47.567 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:47 +0000 (0:00:16.278) 0:03:31.794 ***** 2020-02-08T18:08:47.772 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-02-08T18:08:47.773 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-08T18:08:47.814 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:47 +0000 (0:00:00.246) 0:03:32.041 ***** 2020-02-08T18:08:47.840 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-02-08T18:08:47.878 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:47 +0000 (0:00:00.063) 0:03:32.104 ***** 2020-02-08T18:08:47.914 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-08T18:08:47.915 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-08T18:08:47.956 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:47 +0000 (0:00:00.078) 0:03:32.183 ***** 2020-02-08T18:08:47.994 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-02-08T18:08:47.995 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-02-08T18:08:48.037 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.081) 0:03:32.264 ***** 2020-02-08T18:08:48.073 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-08T18:08:48.075 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-08T18:08:48.113 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.075) 0:03:32.340 ***** 2020-02-08T18:08:48.307 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-02-08T18:08:48.308 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-08T18:08:48.344 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.230) 0:03:32.571 ***** 2020-02-08T18:08:48.541 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-08T18:08:48.543 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2020-02-08T18:08:48.578 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.234) 0:03:32.805 ***** 2020-02-08T18:08:48.605 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-08T18:08:48.606 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:08:48.644 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.065) 0:03:32.870 ***** 2020-02-08T18:08:48.670 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-08T18:08:48.671 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:08:48.717 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.073) 0:03:32.944 ***** 2020-02-08T18:08:48.941 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-02-08T18:08:48.942 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-08T18:08:48.982 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:48 +0000 (0:00:00.265) 0:03:33.209 ***** 2020-02-08T18:08:49.573 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-02-08T18:08:49.574 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-08T18:08:49.610 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:49 +0000 (0:00:00.627) 0:03:33.837 ***** 2020-02-08T18:08:49.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-02-08T18:08:49.648 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi157"}, "changed": false} 2020-02-08T18:08:49.695 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:49 +0000 (0:00:00.085) 0:03:33.922 ***** 2020-02-08T18:08:50.759 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-02-08T18:08:50.760 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi157.front.sepia.ceph.com", "ansible_hostname": "smithi157", "ansible_nodename": "smithi157"}, "changed": true, "name": "smithi157"} 2020-02-08T18:08:50.801 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:50 +0000 (0:00:01.103) 0:03:35.026 ***** 2020-02-08T18:08:51.670 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-02-08T18:08:51.670 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-08T18:08:51.707 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:51 +0000 (0:00:00.907) 0:03:35.933 ***** 2020-02-08T18:08:52.272 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-02-08T18:08:52.274 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-08T18:08:52.316 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:52 +0000 (0:00:00.609) 0:03:36.543 ***** 2020-02-08T18:08:53.072 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-02-08T18:08:53.074 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-08T18:08:53.135 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:53 +0000 (0:00:00.819) 0:03:37.362 ***** 2020-02-08T18:08:53.626 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-08T18:08:53.663 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:53 +0000 (0:00:00.527) 0:03:37.889 ***** 2020-02-08T18:08:53.889 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-08T18:08:53.921 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:53 +0000 (0:00:00.252) 0:03:38.142 ***** 2020-02-08T18:08:54.108 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-08T18:08:54.165 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:54 +0000 (0:00:00.250) 0:03:38.392 ***** 2020-02-08T18:08:54.401 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-08T18:08:54.402 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-08T18:08:54.446 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:54 +0000 (0:00:00.281) 0:03:38.673 ***** 2020-02-08T18:08:54.935 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-08T18:08:54.937 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-08T18:08:54.974 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:54 +0000 (0:00:00.527) 0:03:39.201 ***** 2020-02-08T18:08:55.479 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-08T18:08:55.480 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-08T18:08:55.524 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:55 +0000 (0:00:00.543) 0:03:39.744 ***** 2020-02-08T18:08:57.052 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-08T18:08:57.054 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.338233", "end": "2020-02-08 18:08:57.027967", "rc": 0, "start": "2020-02-08 18:08:55.689734", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:08:57.089 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:57 +0000 (0:00:01.571) 0:03:41.316 ***** 2020-02-08T18:08:57.657 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-02-08T18:08:57.659 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "md5sum": "fed359af26a9f925305897bc0401b3aa", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581185337.13-81151943472609/source", "state": "file", "uid": 0} 2020-02-08T18:08:57.699 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:57 +0000 (0:00:00.609) 0:03:41.926 ***** 2020-02-08T18:08:57.735 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-02-08T18:08:57.783 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:57 +0000 (0:00:00.084) 0:03:42.010 ***** 2020-02-08T18:08:59.002 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-02-08T18:08:59.003 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:01.010865", "end": "2020-02-08 18:08:58.976495", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-08 18:08:57.965630", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-02-08T18:08:59.005 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-08T18:08:59.070 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:59 +0000 (0:00:01.283) 0:03:43.294 ***** 2020-02-08T18:08:59.093 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-02-08T18:08:59.098 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:08:59.132 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:59 +0000 (0:00:00.064) 0:03:43.359 ***** 2020-02-08T18:08:59.168 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-02-08T18:08:59.171 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-08T18:08:59.180 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-08T18:08:59.219 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:08:59 +0000 (0:00:00.086) 0:03:43.446 ***** 2020-02-08T18:09:00.327 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-02-08T18:09:00.328 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.892981", "end": "2020-02-08 18:09:00.304491", "rc": 0, "start": "2020-02-08 18:08:59.411510", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\n33 files removed", "stdout_lines": ["Updating Subscription Management repositories.", "33 files removed"]} 2020-02-08T18:09:00.383 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:00 +0000 (0:00:01.163) 0:03:44.610 ***** 2020-02-08T18:09:00.409 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-08T18:09:00.410 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:09:00.446 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:00 +0000 (0:00:00.063) 0:03:44.673 ***** 2020-02-08T18:09:00.493 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-02-08T18:09:00.495 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:09:00.537 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:00 +0000 (0:00:00.090) 0:03:44.764 ***** 2020-02-08T18:09:00.587 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:09:00.632 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:00 +0000 (0:00:00.094) 0:03:44.858 ***** 2020-02-08T18:09:00.845 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-02-08T18:09:00.846 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006598", "end": "2020-02-08 18:09:00.817100", "msg": "non-zero return code", "rc": 1, "start": "2020-02-08 18:09:00.810502", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-02-08T18:09:00.886 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:00 +0000 (0:00:00.254) 0:03:45.113 ***** 2020-02-08T18:09:00.923 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-02-08T18:09:00.925 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:09:00.962 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:00 +0000 (0:00:00.075) 0:03:45.189 ***** 2020-02-08T18:09:10.062 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-08T18:09:10.063 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-08T18:09:10.115 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:10 +0000 (0:00:09.152) 0:03:54.342 ***** 2020-02-08T18:09:15.279 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-08T18:09:15.280 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: tuned-2.10.0-15.el8.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-02-08T18:09:15.321 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:15 +0000 (0:00:05.205) 0:03:59.547 ***** 2020-02-08T18:09:49.858 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-02-08T18:09:49.860 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:34.324874", "end": "2020-02-08 18:09:49.830356", "rc": 0, "start": "2020-02-08 18:09:15.505482", "stderr": "warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-0161c520b1c9fbf7/packages/smartmontools-7.1-7.el8.x86_64.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY\nImporting GPG key 0x2A8A41EC:\n Userid : \"ktdreyer_ceph-el8 (None) \"\n Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC\n From : https://download.copr.fedorainfracloud.org/results/ktdreyer/ceph-el8/pubkey.gpg\nwarning: /var/cache/dnf/rhel-8-for-x86_64-baseos-rpms-082e7c5698080b56/packages/microcode_ctl-20190618-1.20191115.3.el8_1.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID fd431d51: NOKEY\nImporting GPG key 0xFD431D51:\n Userid : \"Red Hat, Inc. (release key 2) \"\n Fingerprint: 567E 347A D004 4ADE 55BA 8A5F 199E 2F91 FD43 1D51\n From : /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release\nImporting GPG key 0xD4082792:\n Userid : \"Red Hat, Inc. (auxiliary key) \"\n Fingerprint: 6A6A A7C9 7C88 90AE C6AE BFE2 F76F 66C3 D408 2792\n From : /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release", "stderr_lines": ["warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-0161c520b1c9fbf7/packages/smartmontools-7.1-7.el8.x86_64.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY", "Importing GPG key 0x2A8A41EC:", " Userid : \"ktdreyer_ceph-el8 (None) \"", " Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC", " From : https://download.copr.fedorainfracloud.org/results/ktdreyer/ceph-el8/pubkey.gpg", "warning: /var/cache/dnf/rhel-8-for-x86_64-baseos-rpms-082e7c5698080b56/packages/microcode_ctl-20190618-1.20191115.3.el8_1.x86_64.rpm: Head 2020-02-08T18:09:49.862 INFO:teuthology.task.ansible.out:er V3 RSA/SHA256 Signature, key ID fd431d51: NOKEY", "Importing GPG key 0xFD431D51:", " Userid : \"Red Hat, Inc. (release key 2) \"", " Fingerprint: 567E 347A D004 4ADE 55BA 8A5F 199E 2F91 FD43 1D51", " From : /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release", "Importing GPG key 0xD4082792:", " Userid : \"Red Hat, Inc. (auxiliary key) \"", " Fingerprint: 6A6A A7C9 7C88 90AE C6AE BFE2 F76F 66C3 D408 2792", " From : /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release"], "stdout": "Updating Subscription Management repositories.\nCopr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 138 kB/s | 5.3 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - AppStre 87 kB/s | 2.8 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nUpdating Subscription Management repositories.\nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - AppStre 72 kB/s | 2.8 kB 00:00 \nDependencies resolved.\n================================================================================\n Package ArchVersion Repository Size\n================================================================================\nUpgrading:\n smartmo 2020-02-08T18:09:49.863 INFO:teuthology.task.ansible.out:ntools x86_641:7.1-7.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 546 k\n microcode_ctl x86_644:20190618-1.20191115.3.el8_1 rhel-8-for-x86_64-baseos-rpms 2.5 M\n sos noarch3.7-8.el8_1 rhel-8-for-x86_64-baseos-rpms 510 k\n sudo x86_641.8.25p1-8.el8_1 rhel-8-for-x86_64-baseos-rpms 875 k\n systemd-libs x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 560 k\n systemd-pam x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 230 k\n systemd x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 3.5 M\n bpftool x86_644.18.0-147.5.1.el8_1 rhel-8-for-x86_64-baseos-rpms 2.1 M\n systemd-udev x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 1.3 M\n insights-client noarch3.0.8-4.el8_1 rhel-8-for-x86_64-appstream-rpms 899 k\n wget x86_641.19.5-8.el8_1.1 rhel-8-for-x86_64-appstream-rpms 735 k\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\nUpgrade 11 Packages\n\nTotal download size: 14 M\nDownloading Packages:\n(1/11): sos-3.7-8.el8_1.noarch.rpm 9.5 MB/s | 510 kB 00:00 \n(2/11): microcode_ctl-20190618-1.20191115.3.el8 32 MB/s | 2.5 MB 00:00 \n(3/11): smartmontools-7.1-7.el8.x86_64.rpm 6.0 MB/s | 546 kB 00:00 \n(4/11): sudo-1.8.25p1-8.el8_1.x86_64.rpm 17 MB/s | 875 kB 00:00 \n(5/11): systemd-libs-239-18.el8_1.2.x86_64.rpm 16 MB/s | 560 kB 00:00 \n(6/11): systemd-pam-239-18.el8_1.2.x86_64.rpm 5.4 MB/s | 230 kB 00:00 \n(7/ 2020-02-08T18:09:49.864 INFO:teuthology.task.ansible.out:11): bpftool-4.18.0-147.5.1.el8_1.x86_64.rpm 44 MB/s | 2.1 MB 00:00 \n(8/11): systemd-239-18.el8_1.2.x86_64.rpm 46 MB/s | 3.5 MB 00:00 \n(9/11): systemd-udev-239-18.el8_1.2.x86_64.rpm 23 MB/s | 1.3 MB 00:00 \n(10/11): insights-client-3.0.8-4.el8_1.noarch.r 22 MB/s | 899 kB 00:00 \n(11/11): wget-1.19.5-8.el8_1.1.x86_64.rpm 24 MB/s | 735 kB 00:00 \n--------------------------------------------------------------------------------\nTotal 63 MB/s | 14 MB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 24 kB/s | 1.0 kB 00:00 \nKey imported successfully\nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 675 kB/s | 5.0 kB 00:00 \nKey imported successfully\nKey imported successfully\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/1 \n Upgrading : systemd-libs-239-18.el8_1.2.x86_64 1/22 \n Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/22 \n Upgrading : systemd-pam-239-18.el8_1.2.x86_64 2/22 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/22 \n Upgrading : systemd-239-18.el8_1.2.x86_64 3/22 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/22 \n Upgrading : smartmontools-1:7.1-7.el8.x86_64 4/22 \n Running scriptlet: smartmontools-1:7.1-7.el8.x86_64 4/22 \n Upgrading : microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 5/22 \n Running scriptlet: microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 5/22 \n Upgrading : systemd-udev-239-18.el8_1.2.x86_64 2020-02-08T18:09:49.866 INFO:teuthology.task.ansible.out: 6/22 \n Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 6/22 \n Upgrading : insights-client-3.0.8-4.el8_1.noarch 7/22 \n Running scriptlet: insights-client-3.0.8-4.el8_1.noarch 7/22 \n Upgrading : wget-1.19.5-8.el8_1.1.x86_64 8/22 \n Running scriptlet: wget-1.19.5-8.el8_1.1.x86_64 8/22 \n Upgrading : bpftool-4.18.0-147.5.1.el8_1.x86_64 9/22 \n Upgrading : sudo-1.8.25p1-8.el8_1.x86_64 10/22 \n Running scriptlet: sudo-1.8.25p1-8.el8_1.x86_64 10/22 \n Upgrading : sos-3.7-8.el8_1.noarch 11/22 \n Running scriptlet: insights-client-3.0.8-0.el8_0.noarch 12/22 \n Cleanup : insights-client-3.0.8-0.el8_0.noarch 12/22 \n Running scriptlet: insights-client-3.0.8-0.el8_0.noarch 12/22 \n Running scriptlet: microcode_ctl-4:20190618-1.el8.x86_64 13/22 \n Cleanup : microcode_ctl-4:20190618-1.el8.x86_64 13/22 \n Running scriptlet: microcode_ctl-4:20190618-1.el8.x86_64 13/22 \n Cleanup : systemd-udev-239-18.el8.x86_64 14/22 \n Running scriptlet: systemd-udev-239-18.el8.x86_64 14/22 \n Running scriptlet: smartmontools-1:6.6-3.el8.x86_64 15/22 \n Cleanup : smartmontools-1:6.6-3.el8.x86_64 15/22 \n Running scriptlet: smartmontools-1:6.6-3.el8.x86_64 15/22 \n Cleanup : sos-3.7-4.el8.noarch 16/22 \n Cleanup : systemd-pam-239-18.el8.x86_64 17/22 \n Running scriptlet: systemd-239-18.el8.x86_64 18/22 \n Cleanup : systemd-239-18.el8.x86_64 18/22 \n Cleanup : sys 2020-02-08T18:09:49.867 INFO:teuthology.task.ansible.out:temd-libs-239-18.el8.x86_64 19/22 \n Running scriptlet: wget-1.19.5-7.el8_0.1.x86_64 20/22 \n Cleanup : wget-1.19.5-7.el8_0.1.x86_64 20/22 \n Cleanup : bpftool-4.18.0-147.el8.x86_64 21/22 \n Cleanup : sudo-1.8.25p1-7.el8.x86_64 22/22 \n Running scriptlet: microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 22/22 \n Running scriptlet: insights-client-3.0.8-4.el8_1.noarch 22/22 \n Running scriptlet: sudo-1.8.25p1-7.el8.x86_64 22/22 \n Running scriptlet: systemd-239-18.el8_1.2.x86_64 22/22 \n Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 22/22 \n Verifying : smartmontools-1:7.1-7.el8.x86_64 1/22 \n Verifying : smartmontools-1:6.6-3.el8.x86_64 2/22 \n Verifying : microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 3/22 \n Verifying : microcode_ctl-4:20190618-1.el8.x86_64 4/22 \n Verifying : sos-3.7-8.el8_1.noarch 5/22 \n Verifying : sos-3.7-4.el8.noarch 6/22 \n Verifying : sudo-1.8.25p1-8.el8_1.x86_64 7/22 \n Verifying : sudo-1.8.25p1-7.el8.x86_64 8/22 \n Verifying : systemd-libs-239-18.el8_1.2.x86_64 9/22 \n Verifying : systemd-libs-239-18.el8.x86_64 10/22 \n Verifying : systemd-pam-239-18.el8_1.2.x86_64 11/22 \n Verifying : systemd-pam-239-18.el8.x86_64 12/22 \n Verifying : systemd-239-18.el8_1.2.x86_64 13/22 \n Verifying : systemd-239-18.el8.x86_64 14/22 \n Verifying : bpftool-4.18.0-147.5.1.el8_1.x86_64 2020-02-08T18:09:49.869 INFO:teuthology.task.ansible.out: 15/22 \n Verifying : bpftool-4.18.0-147.el8.x86_64 16/22 \n Verifying : systemd-udev-239-18.el8_1.2.x86_64 17/22 \n Verifying : systemd-udev-239-18.el8.x86_64 18/22 \n Verifying : insights-client-3.0.8-4.el8_1.noarch 19/22 \n Verifying : insights-client-3.0.8-0.el8_0.noarch 20/22 \n Verifying : wget-1.19.5-8.el8_1.1.x86_64 21/22 \n Verifying : wget-1.19.5-7.el8_0.1.x86_64 22/22 \nInstalled products updated.\n\nUpgraded:\n smartmontools-1:7.1-7.el8.x86_64 \n microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 \n sos-3.7-8.el8_1.noarch \n sudo-1.8.25p1-8.el8_1.x86_64 \n systemd-libs-239-18.el8_1.2.x86_64 \n systemd-pam-239-18.el8_1.2.x86_64 \n systemd-239-18.el8_1.2.x86_64 \n bpftool-4.18.0-147.5.1.el8_1.x86_64 \n systemd-udev 2020-02-08T18:09:49.869 INFO:teuthology.task.ansible.out:-239-18.el8_1.2.x86_64 \n insights-client-3.0.8-4.el8_1.noarch \n wget-1.19.5-8.el8_1.1.x86_64 \n\nComplete!", "stdout_lines": ["Updating Subscription Management repositories.", "Copr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 138 kB/s | 5.3 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - Ap 2020-02-08T18:09:49.870 INFO:teuthology.task.ansible.out:pStre 87 kB/s | 2.8 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Updating Subscription Management repositories.", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - AppStre 72 kB/s | 2.8 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package ArchVersion Repository Size", "================================================================================", "Upgrading:", " smartmontools x86_641:7.1-7.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 546 k", " microcode_ctl x86_644:20190618-1.20191115.3.el8_1 rhel-8-for-x86_64-baseos-rpms 2.5 M", " sos noarch3.7-8.el8_1 rhel-8-for-x86_64-baseos-rpms 510 k", " sudo x86_641.8.25p1-8.el8_1 rhel-8-for-x86_64-baseos-rpms 875 k", " systemd-libs x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 560 k", " systemd-pam x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 230 k", " systemd x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 3.5 M", " bpftool x86_644.18.0-147.5.1.el8_1 rhel-8-for-x86_64-baseos-rpms 2.1 M", " systemd-ud 2020-02-08T18:09:49.872 INFO:teuthology.task.ansible.out:ev x86_64239-18.el8_1.2 rhel-8-for-x86_64-baseos-rpms 1.3 M", " insights-client noarch3.0.8-4.el8_1 rhel-8-for-x86_64-appstream-rpms 899 k", " wget x86_641.19.5-8.el8_1.1 rhel-8-for-x86_64-appstream-rpms 735 k", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "Upgrade 11 Packages", "", "Total download size: 14 M", "Downloading Packages:", "(1/11): sos-3.7-8.el8_1.noarch.rpm 9.5 MB/s | 510 kB 00:00 ", "(2/11): microcode_ctl-20190618-1.20191115.3.el8 32 MB/s | 2.5 MB 00:00 ", "(3/11): smartmontools-7.1-7.el8.x86_64.rpm 6.0 MB/s | 546 kB 00:00 ", "(4/11): sudo-1.8.25p1-8.el8_1.x86_64.rpm 17 MB/s | 875 kB 00:00 ", "(5/11): systemd-libs-239-18.el8_1.2.x86_64.rpm 16 MB/s | 560 kB 00:00 ", "(6/11): systemd-pam-239-18.el8_1.2.x86_64.rpm 5.4 MB/s | 230 kB 00:00 ", "(7/11): bpftool-4.18.0-147.5.1.el8_1.x86_64.rpm 44 MB/s | 2.1 MB 00:00 ", "(8/11): systemd-239-18.el8_1.2.x86_64.rpm 46 MB/s | 3.5 MB 00:00 ", "(9/11): systemd-udev-239-18.el8_1.2.x86_64.rpm 23 MB/s | 1.3 MB 00:00 ", "(10/11): insights-client-3.0.8-4.el8_1.noarch.r 22 MB/s | 899 kB 00:00 ", "(11/11): wget-1.19.5-8.el8_1.1.x86_64.rpm 24 MB/s | 735 kB 00:00 ", "--------------------------------------------------------------------------------", "Total 63 MB/s | 14 MB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 24 kB/s | 1.0 kB 00:00 ", "Key imported successfully", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 675 kB/s | 5.0 kB 00:00 ", "Key imported successfully", "Key imported successfully", "Running transaction ch 2020-02-08T18:09:49.874 INFO:teuthology.task.ansible.out:eck", "Transaction check succeeded.", "Running transaction test", "Transaction test succeeded.", "Running transaction", " Preparing : 1/1 ", " Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/1 ", " Upgrading : systemd-libs-239-18.el8_1.2.x86_64 1/22 ", " Running scriptlet: systemd-libs-239-18.el8_1.2.x86_64 1/22 ", " Upgrading : systemd-pam-239-18.el8_1.2.x86_64 2/22 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/22 ", " Upgrading : systemd-239-18.el8_1.2.x86_64 3/22 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 3/22 ", " Upgrading : smartmontools-1:7.1-7.el8.x86_64 4/22 ", " Running scriptlet: smartmontools-1:7.1-7.el8.x86_64 4/22 ", " Upgrading : microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 5/22 ", " Running scriptlet: microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 5/22 ", " Upgrading : systemd-udev-239-18.el8_1.2.x86_64 6/22 ", " Running scriptlet: systemd-udev-239-18.el8_1.2.x86_64 6/22 ", " Upgrading : insights-client-3.0.8-4.el8_1.noarch 7/22 ", " Running scriptlet: insights-client-3.0.8-4.el8_1.noarch 7/22 ", " Upgrading : wget-1.19.5-8.el8_1.1.x86_64 8/22 ", " Running scriptlet: wget-1.19.5-8.el8_1.1.x86_64 8/22 ", " Upgrading : bpftool-4.18.0-147.5.1.el8_1.x86_64 9/22 ", " Upgrading : sudo-1.8.25p1-8.el8_1.x86_64 10/22 ", " Running scriptlet: sudo-1.8.25p1-8.el8_1.x86_64 10/22 ", " Upgrading : sos-3.7-8.el8_1.noarch 11/22 ", " Running scriptlet: insights-c 2020-02-08T18:09:49.875 INFO:teuthology.task.ansible.out:lient-3.0.8-0.el8_0.noarch 12/22 ", " Cleanup : insights-client-3.0.8-0.el8_0.noarch 12/22 ", " Running scriptlet: insights-client-3.0.8-0.el8_0.noarch 12/22 ", " Running scriptlet: microcode_ctl-4:20190618-1.el8.x86_64 13/22 ", " Cleanup : microcode_ctl-4:20190618-1.el8.x86_64 13/22 ", " Running scriptlet: microcode_ctl-4:20190618-1.el8.x86_64 13/22 ", " Cleanup : systemd-udev-239-18.el8.x86_64 14/22 ", " Running scriptlet: systemd-udev-239-18.el8.x86_64 14/22 ", " Running scriptlet: smartmontools-1:6.6-3.el8.x86_64 15/22 ", " Cleanup : smartmontools-1:6.6-3.el8.x86_64 15/22 ", " Running scriptlet: smartmontools-1:6.6-3.el8.x86_64 15/22 ", " Cleanup : sos-3.7-4.el8.noarch 16/22 ", " Cleanup : systemd-pam-239-18.el8.x86_64 17/22 ", " Running scriptlet: systemd-239-18.el8.x86_64 18/22 ", " Cleanup : systemd-239-18.el8.x86_64 18/22 ", " Cleanup : systemd-libs-239-18.el8.x86_64 19/22 ", " Running scriptlet: wget-1.19.5-7.el8_0.1.x86_64 20/22 ", " Cleanup : wget-1.19.5-7.el8_0.1.x86_64 20/22 ", " Cleanup : bpftool-4.18.0-147.el8.x86_64 21/22 ", " Cleanup : sudo-1.8.25p1-7.el8.x86_64 22/22 ", " Running scriptlet: microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 22/22 ", " Running scriptlet: insights-client-3.0.8-4.el8_1.noarch 22/22 ", " Running scriptlet: sudo-1.8.25p1-7.el8.x86_64 22/22 ", " Running scriptlet: systemd-239-18.el8_1.2.x86_64 22/22 ", " Running scrip 2020-02-08T18:09:49.877 INFO:teuthology.task.ansible.out:tlet: systemd-udev-239-18.el8_1.2.x86_64 22/22 ", " Verifying : smartmontools-1:7.1-7.el8.x86_64 1/22 ", " Verifying : smartmontools-1:6.6-3.el8.x86_64 2/22 ", " Verifying : microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 3/22 ", " Verifying : microcode_ctl-4:20190618-1.el8.x86_64 4/22 ", " Verifying : sos-3.7-8.el8_1.noarch 5/22 ", " Verifying : sos-3.7-4.el8.noarch 6/22 ", " Verifying : sudo-1.8.25p1-8.el8_1.x86_64 7/22 ", " Verifying : sudo-1.8.25p1-7.el8.x86_64 8/22 ", " Verifying : systemd-libs-239-18.el8_1.2.x86_64 9/22 ", " Verifying : systemd-libs-239-18.el8.x86_64 10/22 ", " Verifying : systemd-pam-239-18.el8_1.2.x86_64 11/22 ", " Verifying : systemd-pam-239-18.el8.x86_64 12/22 ", " Verifying : systemd-239-18.el8_1.2.x86_64 13/22 ", " Verifying : systemd-239-18.el8.x86_64 14/22 ", " Verifying : bpftool-4.18.0-147.5.1.el8_1.x86_64 15/22 ", " Verifying : bpftool-4.18.0-147.el8.x86_64 16/22 ", " Verifying : systemd-udev-239-18.el8_1.2.x86_64 17/22 ", " Verifying : systemd-udev-239-18.el8.x86_64 18/22 ", " Verifying : insights-client-3.0.8-4.el8_1.noarch 19/22 ", " Verifying : insights-client-3.0.8-0.el8_0.noarch 20/22 ", " Verifying : wget-1.19.5-8.el8_1.1.x86_64 21/22 ", " Verifying : wget-1.19.5-7.el8_0.1.x86_64 22/22 ", "Installed products updated.", "", "Upgraded:", " smartmontools-1:7.1-7.el8.x86_64 2020-02-08T18:09:49.878 INFO:teuthology.task.ansible.out: ", " microcode_ctl-4:20190618-1.20191115.3.el8_1.x86_64 ", " sos-3.7-8.el8_1.noarch ", " sudo-1.8.25p1-8.el8_1.x86_64 ", " systemd-libs-239-18.el8_1.2.x86_64 ", " systemd-pam-239-18.el8_1.2.x86_64 ", " systemd-239-18.el8_1.2.x86_64 ", " bpftool-4.18.0-147.5.1.el8_1.x86_64 ", " systemd-udev-239-18.el8_1.2.x86_64 ", " insights-client-3.0.8-4.el8_1.noarch ", " wget-1.19.5-8.el8_1.1.x86_64 ", "", "Complete!"]} 2020-02-08T18:09:49.929 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:09:49 +0000 (0:00:34.607) 0:04:34.155 ***** 2020-02-08T18:11:37.141 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-08T18:11:37.144 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: genisoimage-1.1.11-39.el8.x86_64", "Installed: rdma-core-22.3-1.el8.x86_64", "Installed: qemu-kvm-common-15:2.12.0-88.module+el8.1.0+5149+3ff2765e.2.x86_64", "Installed: httpd-filesystem-2.4.37-16.module+el8.1.0+4134+e6bad0ed.noarch", "Installed: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64", "Installed: git-core-2.18.2-1.el8_1.x86_64", "Installed: qemu-kvm-core-15:2.12.0-88.module+el8.1.0+5149+3ff2765e.2.x86_64", "Installed: libtool-ltdl-2.4.6-25.el8.x86_64", "Installed: kexec-tools-2.0.19-12.el8_1.1.x86_64", "Installed: librdmacm-22.3-1.el8.x86_64", "Installed: libatomic_ops-7.6.2-3.el8.x86_64", "Installed: perl-HTML-Parser-3.72-14.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module+el8.1.0+5149+3ff2765e.2.x86_64", "Installed: edk2-ovmf-20190308git89910a39dcfd-6.el8.noarch", "Installed: podman-1.6.4-2.module+el8.1.1+5363+bf8ff1af.x86_64", "Installed: perl-GSSAPI-0.28-23.el8.x86_64", "Installed: apr-1.6.3-9.el8.x86_64", "Installed: libXv-1.0.11-7.el8.x86_6 2020-02-08T18:11:37.146 INFO:teuthology.task.ansible.out:4", "Installed: glibc-headers-2.28-72.el8_1.1.x86_64", "Installed: libXfixes-5.0.3-7.el8.x86_64", "Installed: perl-TimeDate-1:2.30-13.el8.noarch", "Installed: libwayland-client-1.15.0-1.el8.x86_64", "Installed: slirp4netns-0.4.2-2.git21fdece.module+el8.1.1+5460+3ac089c3.x86_64", "Installed: gstreamer1-plugins-base-1.14.0-4.el8.x86_64", "Installed: subversion-libs-1.10.2-2.module+el8.0.0+3900+919b6753.x86_64", "Installed: openssh-server-8.0p1-4.el8_1.x86_64", "Installed: perl-MailTools-2.20-2.el8.noarch", "Installed: kernel-tools-libs-4.18.0-147.5.1.el8_1.x86_64", "Installed: containernetworking-plugins-0.8.3-4.module+el8.1.1+5259+bcdd613a.x86_64", "Installed: libbabeltrace-1.5.6-2.el8.x86_64", "Installed: libpciaccess-0.14-1.el8.x86_64", "Installed: libX11-xcb-1.6.7-1.el8.x86_64", "Installed: python3-nose-1.3.7-30.module+el8.1.0+3334+5cb623d7.noarch", "Installed: openssh-clients-8.0p1-4.el8_1.x86_64", "Installed: boost-regex-1.66.0-6.el8.x86_64", "Installed: keyutils-1.5.10-6.el8.x86_64", "Installed: mesa-libGL-19.1.4-3.el8_1.x86_64", "Installed: glibc-langpack-en-2.28-72.el8_1.1.x86_64", "Installed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Installed: libusal-1.1.11-39.el8.x86_64", "Installed: libserf-1.3.9-9.module+el8.0.0+3900+919b6753.x86_64", "Installed: conmon-2:2.0.6-1.module+el8.1.1+5259+bcdd613a.x86_64", "Installed: podman-manpages-1.6.4-2.module+el8.1.1+5363+bf8ff1af.noarch", "Installed: mesa-libEGL-19.1.4-3.el8_1.x86_64", "Installed: glibc-2.28-72.el8_1.1.x86_64", "Installed: libglvnd-glx-1:1.0.1-0.9.git5baa1e5.el8.x86_64", "Installed: subversion-1.10.2-2.module+el8.0.0+3900+919b6753.x86_64", "Installed: glibc-common-2.28-72.el8_1.1.x86_64", "Installed: perl-LWP-MediaTypes-6.02-14.el8.noarch", "Installed: python3-dnf-4.2.7-7.el8_1.noarch", "Installed: git-gui-2.18.2-1.el8_1.noarch", "Installed: sgabios-bin-1:0.20170427git-3.module+el8.1.0+4066+0f1aadab.noarch", "Installed: runc-1.0.0-64.rc9.module+el8.1.1+5259+bcdd613a.x86_64", "Installed: boost-iostreams-1. 2020-02-08T18:11:37.147 INFO:teuthology.task.ansible.out:66.0-6.el8.x86_64", "Installed: podman-docker-1.6.4-2.module+el8.1.1+5363+bf8ff1af.noarch", "Installed: perl-YAML-1.24-3.module+el8.1.0+2934+4e5567df.noarch", "Installed: kernel-headers-4.18.0-147.5.1.el8_1.x86_64", "Installed: tcl-1:8.6.8-2.el8.x86_64", "Installed: libcacard-3:2.7.0-2.el8_1.x86_64", "Installed: dracut-config-rescue-049-27.git20190906.el8_1.1.x86_64", "Installed: git-subtree-2.18.2-1.el8_1.x86_64", "Installed: libvisual-1:0.4.0-24.el8.x86_64", "Installed: device-mapper-multipath-libs-0.8.0-5.el8.x86_64", "Installed: libattr-devel-2.4.48-3.el8.x86_64", "Installed: perl-HTML-Tagset-3.20-33.el8.noarch", "Installed: platform-python-devel-3.6.8-15.1.el8.x86_64", "Installed: rpcbind-1.2.5-4.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: python-rpm-macros-3-37.el8.noarch", "Installed: dnf-data-4.2.7-7.el8_1.noarch", "Installed: apr-util-openssl-1.6.1-6.el8.x86_64", "Installed: libXxf86vm-1.1.4-9.el8.x86_64", "Installed: xml-common-0.6.3-50.el8.noarch", "Installed: libepoxy-1.5.2-1.el8.x86_64", "Installed: kernel-tools-4.18.0-147.5.1.el8_1.x86_64", "Installed: libvorbis-1:1.3.6-2.el8.x86_64", "Installed: perl-Error-1:0.17025-2.el8.noarch", "Installed: libtheora-1:1.1.1-21.el8.x86_64", "Installed: orc-0.4.28-2.el8.x86_64", "Installed: seabios-bin-1.11.1-4.module+el8.1.0+4066+0f1aadab.noarch", "Installed: redhat-logos-httpd-81.1-1.el8.noarch", "Installed: boost-date-time-1.66.0-6.el8.x86_64", "Installed: glusterfs-api-6.0-20.el8.x86_64", "Installed: git-2.18.2-1.el8_1.x86_64", "Installed: glusterfs-6.0-20.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: autoconf-2.69-27.el8.noarch", "Installed: python3-rpm-generators-5-4.el8.noarch", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: git-core-doc-2.18.2-1.el8_1.noarch", "Installed: libxshmfence-1.3-2.el8.x86_64", "Installed: libdatrie-0.2.9-7.el8.x86_64", "Installed: nfs-utils-1:2.3.3-26.el8.x86_64", "Installed: NetworkManager-tui-1:1.20.0-5.el8_1. 2020-02-08T18:11:37.149 INFO:teuthology.task.ansible.out:x86_64", "Installed: glusterfs-libs-6.0-20.el8.x86_64", "Installed: libwayland-cursor-1.15.0-1. 2020-02-08T18:11:37.149 INFO:teuthology.task.ansible.out:el8.x86_64", "Installed: NetworkManager-1:1.20.0-5.el8_1.x86_64", "Installed: libXft-2.3.2-10.el8.x86_64", "Installed: glusterfs-client-xlators-6.0-20.el8.x86_64", "Installed: dracut-network-049-27.git20190906.el8_1.1.x86_64", "Installed: tk-1:8.6.8-1.el8.x86_64", "Installed: gssproxy-0.8.0-14.el8.x86_64", "Installed: setup-2.12.2-2.el8_1.1.noarch", "Installed: perl-IO-HTML-1.001-10.el8.noarch", "Installed: gitk-2.18.2-1.el8_1.noarch", "Installed: userspace-rcu-0.10.1-2.el8.x86_64", "Installed: guile-5:2.0.14-7.el8.x86_64", "Installed: gstreamer1-1.14.0-3.el8.x86_64", "Installed: perl-Git-2.18.2-1.el8_1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: opus-1.3-0.4.beta.el8.x86_64", "Installed: yum-4.2.7-7.el8_1.noarch", "Installed: dnf-4.2.7-7.el8_1.noarch", "Installed: perl-Digest-HMAC-1.03-17.el8.noarch", "Installed: utf8proc-2.1.1-5.module+el8.0.0+3900+919b6753.x86_64", "Installed: libibumad-22.3-1.el8.x86_64", "Installed: yum-utils-4.0.8-3.el8.noarch", "Installed: libxcrypt-devel-4.1.1-4.el8.x86_64", "Installed: httpd-tools-2.4.37-16.module+el8.1.0+4134+e6bad0ed.x86_64", "Installed: dracut-squash-049-27.git20190906.el8_1.1.x86_64", "Installed: cpp-8.3.1-4.5.el8.x86_64", "Installed: libverto-libevent-0.3.0-5.el8.x86_64", "Installed: python3-wheel-wheel-1:0.31.1-2.module+el8.1.0+3724+3c097090.noarch", "Installed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Installed: spice-server-0.14.2-1.el8.x86_64", "Installed: git-svn-2.18.2-1.el8_1.x86_64", "Installed: gcc-8.3.1-4.5.el8.x86_64", "Installed: libdnf-0.35.1-9.el8_1.x86_64", "Installed: libibverbs-22.3-1.el8.x86_64", "Installed: perl-HTTP-Date-6.02-18.el8.noarch", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: git-all-2.18.2-1.el8_1.noarch", "Installed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Installed: iso-codes-3.79-2.el8.noarch", "Installed: libmpc-1.0.2-9.el8.x86_64", "Installed: perl-HTTP-Message-6.1 2020-02-08T18:11:37.150 INFO:teuthology.task.ansible.out:8-1.el8.noarch", "Installed: dracut-049-27.git20190906.el8_1.1.x86_64", "Installed: perl-Net-SMTP-SSL-1.04-5.el8.noarch", "Installed: libXdamage-1.1.4-14.el8.x86_64", "Installed: valgrind-1:3.15.0-9.el8.x86_64", "Installed: apr-util-1.6.1-6.el8.x86_64", "Installed: annobin-8.78-1.el8.x86_64", "Installed: celt051-0.5.1.3-15.el8.x86_64", "Installed: gdb-headless-8.2-6.el8_0.x86_64", "Installed: ipxe-roms-qemu-20181214-3.git133f4c47.el8.noarch", "Installed: python36-devel-3.6.8-2.module+el8.1.0+3334+5cb623d7.x86_64", "Installed: libpmem-1.6-2.el8.x86_64", "Installed: gc-7.6.4-3.el8.x86_64", "Installed: gitweb-2.18.2-1.el8_1.noarch", "Installed: libvarlink-18-3.el8.x86_64", "Installed: graphite2-1.3.10-10.el8.x86_64", "Installed: boost-chrono-1.66.0-6.el8.x86_64", "Installed: subversion-perl-1.10.2-2.module+el8.0.0+3900+919b6753.x86_64", "Installed: libglvnd-egl-1:1.0.1-0.9.git5baa1e5.el8.x86_64", "Installed: libwayland-egl-1.15.0-1.el8.x86_64", "Installed: libglvnd-1:1.0.1-0.9.git5baa1e5.el8.x86_64", "Installed: libthai-0.1.27-2.el8.x86_64", "Installed: boost-atomic-1.66.0-6.el8.x86_64", "Installed: mod_http2-1.11.3-3.module+el8.1.0+4134+e6bad0ed.x86_64", "Installed: mesa-libglapi-19.1.4-3.el8_1.x86_64", "Installed: python3-virtualenv-15.1.0-19.module+el8.1.0+3514+14e79d98.noarch", "Installed: libdrm-2.4.98-2.el8.x86_64", "Installed: httpd-2.4.37-16.module+el8.1.0+4134+e6bad0ed.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: gdb-8.2-6.el8_0.x86_64", "Installed: perl-Git-SVN-2.18.2-1.el8_1.noarch", "Installed: libacl-devel-2.2.53-1.el8.x86_64", "Installed: perl-CGI-4.38-2.el8.noarch", "Installed: pango-1.42.4-6.el8.x86_64", "Installed: libwayland-server-1.15.0-1.el8.x86_64", "Installed: libglvnd-gles-1:1.0.1-0.9.git5baa1e5.el8.x86_64", "Installed: libogg-2:1.3.2-10.el8.x86_64", "Installed: libipt-1.6.1-8.el8.x86_64", "Installed: fribidi-1.0.4-7.el8_1.x86_64", "Installed: NetworkManager-team-1:1.20.0-5.el8_1.x86_64", "Installed: git-instaweb-2.18.2-1.e 2020-02-08T18:11:37.157 INFO:teuthology.task.ansible.out:l8_1.x86_64", "Installed: harfbuzz-1.7.5-3.el8.x86_64", "Installed: isl-0.16.1-6.el8.x86_64", "Installed: git-email-2.18.2-1.el8_1.noarch", "Installed: openssh-8.0p1-4.el8_1.x86_64", "Installed: glibc-devel-2.28-72.el8_1.1.x86_64", "Installed: apr-util-bdb-1.6.1-6.el8.x86_64", "Installed: mesa-libgbm-19.1.4-3.el8_1.x86_64", "Installed: qemu-img-15:2.12.0-88.module+el8.1.0+5149+3ff2765e.2.x86_64", "Installed: perl-Authen-SASL-2.16-13.el8.noarch", "Installed: seavgabios-bin-1.11.1-4.module+el8.1.0+4066+0f1aadab.noarch", "Removed: libdnf-0.35.1-8.el8.x86_64", "Removed: NetworkManager-1:1.20.0-3.el8.x86_64", "Removed: NetworkManager-libnm-1:1.20.0-3.el8.x86_64", "Removed: NetworkManager-team-1:1.20.0-3.el8.x86_64", "Removed: NetworkManager-tui-1:1.20.0-3.el8.x86_64", "Removed: yum-4.2.7-6.el8.noarch", "Removed: glibc-2.28-72.el8.x86_64", "Removed: glibc-common-2.28-72.el8.x86_64", "Removed: glibc-langpack-en-2.28-72.el8.x86_64", "Removed: openssh-8.0p1-3.el8.x86_64", "Removed: openssh-clients-8.0p1-3.el8.x86_64", "Removed: openssh-server-8.0p1-3.el8.x86_64", "Removed: runc-1.0.0-56.rc8.dev.git425e105.module+el8.0.0+4017+bbba319f.x86_64", "Removed: containernetworking-plugins-0.7.4-3.git9ebe139.module+el8+2769+577ad176.x86_64", "Removed: setup-2.12.2-2.el8.noarch", "Removed: podman-1.0.5-1.gitf604175.module+el8.0.0+4017+bbba319f.x86_64", "Removed: slirp4netns-0.1-2.dev.gitc4e1bc5.module+el8+2769+577ad176.x86_64", "Removed: kernel-tools-4.18.0-147.el8.x86_64", "Removed: kernel-tools-libs-4.18.0-147.el8.x86_64", "Removed: kexec-tools-2.0.19-12.el8.x86_64", "Removed: dnf-4.2.7-6.el8.noarch", "Removed: dnf-data-4.2.7-6.el8.noarch", "Removed: python3-dnf-4.2.7-6.el8.noarch", "Removed: dracut-049-27.git20190906.el8.x86_64", "Removed: dracut-config-rescue-049-27.git20190906.el8.x86_64", "Removed: dracut-network-049-27.git20190906.el8.x86_64", "Removed: python3-hawkey-0.35.1-8.el8.x86_64", "Removed: dracut-squash-049-27.git20190906.el8.x86_64", "Removed: python3-libdnf-0.35.1-8. 2020-02-08T18:11:37.158 INFO:teuthology.task.ansible.out:el8.x86_64"]} 2020-02-08T18:11:37.216 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:37 +0000 (0:01:47.286) 0:06:21.442 ***** 2020-02-08T18:11:42.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-02-08T18:11:42.781 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dbench", "Installed: dbench-4.0-20.el8.x86_64"]} 2020-02-08T18:11:42.825 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:42 +0000 (0:00:05.609) 0:06:27.052 ***** 2020-02-08T18:11:44.785 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-08T18:11:44.817 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:44 +0000 (0:00:01.992) 0:06:29.044 ***** 2020-02-08T18:11:44.858 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:44.900 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:44 +0000 (0:00:00.082) 0:06:29.127 ***** 2020-02-08T18:11:45.256 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-02-08T18:11:45.258 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service sysinit.target basic.target polkit.service dbus.socket system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ebtables.service shutdown.target ipset.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-08T18:11:45.259 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", 2020-02-08T18:11:45.261 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-02-08T18:11:45.262 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-08T18:11:45.297 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:45 +0000 (0:00:00.397) 0:06:29.524 ***** 2020-02-08T18:11:45.602 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-02-08T18:11:45.603 INFO:teuthology.task.ansible.out:fatal: [smithi157.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-02-08T18:11:45.664 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:45 +0000 (0:00:00.366) 0:06:29.891 ***** 2020-02-08T18:11:46.400 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-02-08T18:11:46.402 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-02-08T18:11:46.460 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.795) 0:06:30.686 ***** 2020-02-08T18:11:46.488 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-02-08T18:11:46.490 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:46.527 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.067) 0:06:30.754 ***** 2020-02-08T18:11:46.556 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-02-08T18:11:46.598 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.070) 0:06:30.825 ***** 2020-02-08T18:11:46.624 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-02-08T18:11:46.626 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:46.681 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.082) 0:06:30.908 ***** 2020-02-08T18:11:46.725 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:46.770 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.086) 0:06:30.994 ***** 2020-02-08T18:11:46.807 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-02-08T18:11:46.808 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:46.818 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:46.865 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.097) 0:06:31.091 ***** 2020-02-08T18:11:46.901 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-02-08T18:11:46.902 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:46.948 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:46 +0000 (0:00:00.081) 0:06:31.173 ***** 2020-02-08T18:11:46.978 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-02-08T18:11:47.015 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.068) 0:06:31.242 ***** 2020-02-08T18:11:47.043 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-02-08T18:11:47.044 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.084 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.068) 0:06:31.311 ***** 2020-02-08T18:11:47.112 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.154 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.067) 0:06:31.378 ***** 2020-02-08T18:11:47.177 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.220 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.067) 0:06:31.445 ***** 2020-02-08T18:11:47.261 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.301 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.081) 0:06:31.527 ***** 2020-02-08T18:11:47.334 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.371 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.068) 0:06:31.596 ***** 2020-02-08T18:11:47.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.433 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.063) 0:06:31.660 ***** 2020-02-08T18:11:47.459 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-02-08T18:11:47.460 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.499 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.064) 0:06:31.724 ***** 2020-02-08T18:11:47.523 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-02-08T18:11:47.524 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.572 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.070) 0:06:31.794 ***** 2020-02-08T18:11:47.593 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-02-08T18:11:47.595 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.633 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.065) 0:06:31.860 ***** 2020-02-08T18:11:47.659 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.696 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.062) 0:06:31.922 ***** 2020-02-08T18:11:47.727 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.760 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.064) 0:06:31.987 ***** 2020-02-08T18:11:47.786 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-02-08T18:11:47.788 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.824 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.063) 0:06:32.051 ***** 2020-02-08T18:11:47.851 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-02-08T18:11:47.852 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.906 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.081) 0:06:32.133 ***** 2020-02-08T18:11:47.935 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-02-08T18:11:47.938 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:47.972 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:47 +0000 (0:00:00.065) 0:06:32.198 ***** 2020-02-08T18:11:47.998 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.040 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.068) 0:06:32.267 ***** 2020-02-08T18:11:48.066 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-08T18:11:48.067 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.104 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.062) 0:06:32.329 ***** 2020-02-08T18:11:48.129 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.166 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.064) 0:06:32.393 ***** 2020-02-08T18:11:48.203 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-08T18:11:48.204 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.242 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.075) 0:06:32.469 ***** 2020-02-08T18:11:48.268 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-08T18:11:48.269 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.308 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.065) 0:06:32.535 ***** 2020-02-08T18:11:48.338 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.370 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.061) 0:06:32.596 ***** 2020-02-08T18:11:48.408 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.450 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.078) 0:06:32.675 ***** 2020-02-08T18:11:48.474 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-08T18:11:48.475 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.512 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.062) 0:06:32.738 ***** 2020-02-08T18:11:48.542 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.580 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.068) 0:06:32.806 ***** 2020-02-08T18:11:48.614 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.678 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.092) 0:06:32.899 ***** 2020-02-08T18:11:48.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.744 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.071) 0:06:32.970 ***** 2020-02-08T18:11:48.772 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-08T18:11:48.774 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.814 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.070) 0:06:33.041 ***** 2020-02-08T18:11:48.841 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-08T18:11:48.842 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.889 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.074) 0:06:33.116 ***** 2020-02-08T18:11:48.914 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-08T18:11:48.922 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:48.953 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:48 +0000 (0:00:00.064) 0:06:33.180 ***** 2020-02-08T18:11:48.979 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-08T18:11:48.980 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.018 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.064) 0:06:33.244 ***** 2020-02-08T18:11:49.047 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-08T18:11:49.049 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.086 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.068) 0:06:33.313 ***** 2020-02-08T18:11:49.117 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.163 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.076) 0:06:33.390 ***** 2020-02-08T18:11:49.190 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-08T18:11:49.403 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 08 February 2020 18:11:49 +0000 (0:00:00.064) 0:06:33.454 ***** TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 08 February 2020 18:11:49 +0000 (0:00:00.083) 0:06:33.537 ***** TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 08 February 2020 18:11:49 +0000 (0:00:00.066) 0:06:33.604 ***** 2020-02-08T18:11:49.417 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-08T18:11:49.419 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.457 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.080) 0:06:33.684 ***** 2020-02-08T18:11:49.487 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.524 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.066) 0:06:33.750 ***** 2020-02-08T18:11:49.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-08T18:11:49.551 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.595 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.065) 0:06:33.816 ***** 2020-02-08T18:11:49.615 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-08T18:11:49.617 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.656 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.066) 0:06:33.883 ***** 2020-02-08T18:11:49.683 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.721 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.064) 0:06:33.948 ***** 2020-02-08T18:11:49.750 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-08T18:11:49.756 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.786 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.065) 0:06:34.013 ***** 2020-02-08T18:11:49.812 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-08T18:11:49.813 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.851 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.064) 0:06:34.077 ***** 2020-02-08T18:11:49.876 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-08T18:11:49.878 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.919 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.067) 0:06:34.145 ***** 2020-02-08T18:11:49.950 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:49.982 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:49 +0000 (0:00:00.063) 0:06:34.209 ***** 2020-02-08T18:11:50.007 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-08T18:11:50.010 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.045 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.062) 0:06:34.272 ***** 2020-02-08T18:11:50.074 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-02-08T18:11:50.075 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.117 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.071) 0:06:34.344 ***** 2020-02-08T18:11:50.143 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-08T18:11:50.144 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.187 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.070) 0:06:34.414 ***** 2020-02-08T18:11:50.213 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.252 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.064) 0:06:34.478 ***** 2020-02-08T18:11:50.279 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.322 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.066) 0:06:34.545 ***** 2020-02-08T18:11:50.344 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-02-08T18:11:50.346 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.383 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.064) 0:06:34.610 ***** 2020-02-08T18:11:50.409 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-08T18:11:50.411 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.447 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.063) 0:06:34.673 ***** 2020-02-08T18:11:50.472 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-08T18:11:50.473 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.510 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.063) 0:06:34.736 ***** 2020-02-08T18:11:50.546 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-08T18:11:50.548 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-02-08T18:11:50.594 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.082) 0:06:34.819 ***** 2020-02-08T18:11:50.629 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi157.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.650 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-08T18:11:50.663 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.665 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.675 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.691 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi157.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-08T18:11:50.732 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.139) 0:06:34.958 ***** 2020-02-08T18:11:50.920 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-08T18:11:50.921 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005977", "end": "2020-02-08 18:11:50.899544", "rc": 0, "start": "2020-02-08 18:11:50.893567", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-08T18:11:50.968 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:50 +0000 (0:00:00.236) 0:06:35.195 ***** 2020-02-08T18:11:51.005 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:51.067 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:51 +0000 (0:00:00.099) 0:06:35.294 ***** 2020-02-08T18:11:51.106 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-02-08T18:11:51.107 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:51.145 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:51 +0000 (0:00:00.077) 0:06:35.372 ***** 2020-02-08T18:11:51.183 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-08T18:11:51.185 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:51.227 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:51 +0000 (0:00:00.080) 0:06:35.453 ***** 2020-02-08T18:11:51.252 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-02-08T18:11:51.253 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:51.291 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:51 +0000 (0:00:00.065) 0:06:35.518 ***** 2020-02-08T18:11:53.196 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-02-08T18:11:53.197 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-08T18:11:53.258 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:53 +0000 (0:00:01.963) 0:06:37.482 ***** 2020-02-08T18:11:53.315 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi157.front.sepia.ceph.com] => (item={u'block_used': 12797216, u'uuid': u'95d74f27-e719-48ed-958a-d4a7074e7a81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227297892, u'size_available': 931012165632, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 61000000, u'device': u'/dev/sda1', u'inode_used': 54976, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227297892, "block_size": 4096, "block_total": 240095108, "block_used": 12797216, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 61000000, "inode_total": 61054976, "inode_used": 54976, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 931012165632, "size_total": 983429562368, "uuid": "95d74f27-e719-48ed-958a-d4a7074e7a81"}} 2020-02-08T18:11:53.382 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:53 +0000 (0:00:00.126) 0:06:37.608 ***** 2020-02-08T18:11:53.602 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005119", "end": "2020-02-08 18:11:53.565810", "rc": 0, "start": "2020-02-08 18:11:53.560691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:11:53.662 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:53 +0000 (0:00:00.280) 0:06:37.889 ***** 2020-02-08T18:11:53.725 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-08T18:11:53.725 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={u'block_used': 12797216, u'uuid': u'95d74f27-e719-48ed-958a-d4a7074e7a81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227297892, u'size_available': 931012165632, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 61000000, u'device': u'/dev/sda1', u'inode_used': 54976, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227297892, "block_size": 4096, "block_total": 240095108, "block_used": 12797216, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 61000000, "inode_total": 61054976, "inode_used": 54976, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 931012165632, "size_total": 983429562368, "uuid": "95d74f27-e719-48ed-958a-d4a7074e7a81"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:53.804 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:53 +0000 (0:00:00.141) 0:06:38.031 ***** 2020-02-08T18:11:53.834 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-08T18:11:53.872 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:11:53 +0000 (0:00:00.067) 0:06:38.099 ***** 2020-02-08T18:11:53.934 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPK', u'wwn-0x5000c50092924b2b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFPK', u'wwn': u'0x5000c50092924b2b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'95d74f27-e719-48ed-958a-d4a7074e7a81', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1', u'wwn-0x5000c50092924b2b-part1'], u'uuids': [u'95d74f27-e719-48ed-958a-d4a7074e7a81']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK", "wwn-0x5000c50092924b2b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1", "wwn-0x5000c50092924b2b-part1"], "labels": [], "masters": [], "uuids": ["95d74f27-e719-48ed-958a-d4a7074e7a81"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "95d74f27-e719-48ed-958a-d4a7074e7a81"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsi 2020-02-08T18:11:53.938 INFO:teuthology.task.ansible.out:ze": "512", "serial": "Z1W5XFPK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092924b2b"}}, "skip_reason": "Conditional result was False"} 2020-02-08T18:11:55.584 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-4MZZ2z-AMAw-ACyY-1lJJ-0g7s-PCnN-3rHfa1', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN', u'nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.402003", "end": "2020-02-08 18:11:55.552483", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-4MZZ2z-AMAw-ACyY-1lJJ-0g7s-PCnN-3rHfa1", "nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN", "nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:11:54.150480", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-02-08T18:11:55.586 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-08T18:11:56.857 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGVHVhO1vLOj5fnO81gwagLXuRR2LEl85c'], u'uuids': [u'bc084c86-8e2e-4033-b92e-1494936732d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.063660", "end": "2020-02-08 18:11:56.818352", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGVHVhO1vLOj5fnO81gwagLXuRR2LEl85c"], "labels": [], "masters": [], "uuids": ["bc084c86-8e2e-4033-b92e-1494936732d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:11:55.754692", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-08T18:11:58.142 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGSksdaWCnm9jnf7OIP8g8vLUWnLU7HiPq'], u'uuids': [u'18290aa3-2fa9-4042-ab40-89ce08ef56bb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.069439", "end": "2020-02-08 18:11:58.109606", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGSksdaWCnm9jnf7OIP8g8vLUWnLU7HiPq"], "labels": [], "masters": [], "uuids": ["18290aa3-2fa9-4042-ab40-89ce08ef56bb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:11:57.040167", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-08T18:11:59.407 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGQluenAQBPKKYNEaMlb2yTwUjaYrOLdbc'], u'uuids': [u'60bb3be1-fd57-444a-beaf-730e7785698c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.068478", "end": "2020-02-08 18:11:59.379213", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGQluenAQBPKKYNEaMlb2yTwUjaYrOLdbc"], "labels": [], "masters": [], "uuids": ["60bb3be1-fd57-444a-beaf-730e7785698c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:11:58.310735", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-08T18:12:00.669 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGmkwvlSRrAacmFghXyNIaNBYidaPqaegd'], u'uuids': [u'397fb7a2-1d86-4ef5-9cfd-aed304a0ff5b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.050499", "end": "2020-02-08 18:12:00.628237", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGmkwvlSRrAacmFghXyNIaNBYidaPqaegd"], "labels": [], "masters": [], "uuids": ["397fb7a2-1d86-4ef5-9cfd-aed304a0ff5b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:11:59.577738", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-08T18:12:01.925 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGjCnQzdYVUXz0j2DDZRX5nsneuzXfpBpw'], u'uuids': [u'330c3c73-08f5-4090-9d67-6c68648cab38']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.046377", "end": "2020-02-08 18:12:01.886160", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGjCnQzdYVUXz0j2DDZRX5nsneuzXfpBpw"], "labels": [], "masters": [], "uuids": ["330c3c73-08f5-4090-9d67-6c68648cab38"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:00.839783", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-08T18:12:01.997 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:01 +0000 (0:00:08.124) 0:06:46.224 ***** 2020-02-08T18:12:02.048 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-08T18:12:02.048 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPK', u'wwn-0x5000c50092924b2b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFPK', u'wwn': u'0x5000c50092924b2b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'95d74f27-e719-48ed-958a-d4a7074e7a81', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1', u'wwn-0x5000c50092924b2b-part1'], u'uuids': [u'95d74f27-e719-48ed-958a-d4a7074e7a81']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK", "wwn-0x5000c50092924b2b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPK-part1", "wwn-0x5000c50092924b2b-part1"], "labels": [], "masters": [], "uuids": ["95d74f27-e719-48ed-958a-d4a7074e7a81"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "95d74f27-e719-48ed-958a-d4a7074e7a81"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPK", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-08T18:12:02.050 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092924b2b"}}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:02.296 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-4MZZ2z-AMAw-ACyY-1lJJ-0g7s-PCnN-3rHfa1', u'nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN', u'nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037612", "end": "2020-02-08 18:12:02.270397", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-4MZZ2z-AMAw-ACyY-1lJJ-0g7s-PCnN-3rHfa1", "nvme-INTEL_SSDPEDMD400G4_CVFT623300G9400BGN", "nvme-nvme.8086-43564654363233333030473934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:02.232785", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-02-08T18:12:02.298 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0349711 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349711 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:02.641 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGVHVhO1vLOj5fnO81gwagLXuRR2LEl85c'], u'uuids': [u'bc084c86-8e2e-4033-b92e-1494936732d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142075", "end": "2020-02-08 18:12:02.610381", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGVHVhO1vLOj5fnO81gwagLXuRR2LEl85c"], "labels": [], "masters": [], "uuids": ["bc084c86-8e2e-4033-b92e-1494936732d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:02.468306", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139456 s, 827 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139456 s, 827 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:02.973 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGSksdaWCnm9jnf7OIP8g8vLUWnLU7HiPq'], u'uuids': [u'18290aa3-2fa9-4042-ab40-89ce08ef56bb']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.142062", "end": "2020-02-08 18:12:02.951019", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGSksdaWCnm9jnf7OIP8g8vLUWnLU7HiPq"], "labels": [], "masters": [], "uuids": ["18290aa3-2fa9-4042-ab40-89ce08ef56bb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:02.808957", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139454 s, 827 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139454 s, 827 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:03.307 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGQluenAQBPKKYNEaMlb2yTwUjaYrOLdbc'], u'uuids': [u'60bb3be1-fd57-444a-beaf-730e7785698c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.137450", "end": "2020-02-08 18:12:03.273126", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGQluenAQBPKKYNEaMlb2yTwUjaYrOLdbc"], "labels": [], "masters": [], "uuids": ["60bb3be1-fd57-444a-beaf-730e7785698c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:03.135676", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135019 s, 854 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135019 s, 854 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:03.648 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGmkwvlSRrAacmFghXyNIaNBYidaPqaegd'], u'uuids': [u'397fb7a2-1d86-4ef5-9cfd-aed304a0ff5b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140017", "end": "2020-02-08 18:12:03.617104", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGmkwvlSRrAacmFghXyNIaNBYidaPqaegd"], "labels": [], "masters": [], "uuids": ["397fb7a2-1d86-4ef5-9cfd-aed304a0ff5b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:03.477087", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137524 s, 839 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137524 s, 839 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:03.969 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGjCnQzdYVUXz0j2DDZRX5nsneuzXfpBpw'], u'uuids': [u'330c3c73-08f5-4090-9d67-6c68648cab38']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138182", "end": "2020-02-08 18:12:03.944281", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rG08AtG13xV87JD386frS7B72vUtAnlGjCnQzdYVUXz0j2DDZRX5nsneuzXfpBpw"], "labels": [], "masters": [], "uuids": ["330c3c73-08f5-4090-9d67-6c68648cab38"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-08 18:12:03.806099", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135691 s, 850 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135691 s, 850 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:04.024 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:02.026) 0:06:48.251 ***** 2020-02-08T18:12:04.300 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi157.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.055929", "end": "2020-02-08 18:12:04.269230", "rc": 0, "start": "2020-02-08 18:12:04.213301", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:04.339 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:00.315) 0:06:48.566 ***** 2020-02-08T18:12:04.579 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.040194", "end": "2020-02-08 18:12:04.557031", "rc": 0, "start": "2020-02-08 18:12:04.516837", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:04.641 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:00.302) 0:06:48.868 ***** 2020-02-08T18:12:04.674 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-08T18:12:04.748 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:00.106) 0:06:48.975 ***** 2020-02-08T18:12:04.776 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-02-08T18:12:04.779 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:04.816 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:00.067) 0:06:49.043 ***** 2020-02-08T18:12:04.852 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-02-08T18:12:04.854 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:04.894 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:00.073) 0:06:49.116 ***** 2020-02-08T18:12:04.936 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:04.993 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:04 +0000 (0:00:00.103) 0:06:49.219 ***** 2020-02-08T18:12:05.020 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-02-08T18:12:05.021 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.063 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.070) 0:06:49.290 ***** 2020-02-08T18:12:05.277 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-08T18:12:05.344 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.276) 0:06:49.566 ***** 2020-02-08T18:12:05.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi157.front.sepia.ceph.com] => (item={u'block_used': 12797216, u'uuid': u'95d74f27-e719-48ed-958a-d4a7074e7a81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227297892, u'size_available': 931012165632, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 61000000, u'device': u'/dev/sda1', u'inode_used': 54976, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227297892, "block_size": 4096, "block_total": 240095108, "block_used": 12797216, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 61000000, "inode_total": 61054976, "inode_used": 54976, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 931012165632, "size_total": 983429562368, "uuid": "95d74f27-e719-48ed-958a-d4a7074e7a81"}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.452 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.113) 0:06:49.679 ***** 2020-02-08T18:12:05.493 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.534 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.081) 0:06:49.760 ***** 2020-02-08T18:12:05.581 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-08T18:12:05.582 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.621 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.087) 0:06:49.848 ***** 2020-02-08T18:12:05.648 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-08T18:12:05.649 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.692 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.071) 0:06:49.919 ***** 2020-02-08T18:12:05.694 INFO:teuthology.task.ansible.out: 2020-02-08T18:12:05.734 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.778 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.085) 0:06:50.005 ***** 2020-02-08T18:12:05.816 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.855 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.077) 0:06:50.082 ***** 2020-02-08T18:12:05.889 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:05.946 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:05 +0000 (0:00:00.087) 0:06:50.170 ***** 2020-02-08T18:12:06.679 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-02-08T18:12:06.680 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-02-08T18:12:06.725 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:06 +0000 (0:00:00.781) 0:06:50.952 ***** 2020-02-08T18:12:07.422 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-08T18:12:07.424 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-08T18:12:07.772 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-08T18:12:08.136 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-08T18:12:08.486 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-08T18:12:08.874 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-08T18:12:08.920 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:08 +0000 (0:00:02.193) 0:06:53.145 ***** 2020-02-08T18:12:09.138 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-08T18:12:09.180 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:09 +0000 (0:00:00.261) 0:06:53.407 ***** 2020-02-08T18:12:09.229 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-08T18:12:09.233 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:09.442 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-08T18:12:09.954 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-08T18:12:10.291 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-08T18:12:10.490 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-08T18:12:10.532 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:10 +0000 (0:00:01.351) 0:06:54.759 ***** 2020-02-08T18:12:10.751 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-02-08T18:12:10.752 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-08T18:12:10.798 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:10 +0000 (0:00:00.266) 0:06:55.025 ***** 2020-02-08T18:12:10.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-02-08T18:12:10.828 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:10.879 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:10 +0000 (0:00:00.080) 0:06:55.105 ***** 2020-02-08T18:12:12.496 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-02-08T18:12:12.498 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true} 2020-02-08T18:12:12.542 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:12 +0000 (0:00:01.663) 0:06:56.769 ***** 2020-02-08T18:12:13.145 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-02-08T18:12:13.147 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-02-08T18:12:13.191 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.648) 0:06:57.418 ***** 2020-02-08T18:12:13.228 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-02-08T18:12:13.230 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.298 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.106) 0:06:57.524 ***** 2020-02-08T18:12:13.345 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.374 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.076) 0:06:57.601 ***** 2020-02-08T18:12:13.402 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-02-08T18:12:13.403 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.441 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.066) 0:06:57.668 ***** 2020-02-08T18:12:13.468 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.516 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.075) 0:06:57.743 ***** 2020-02-08T18:12:13.553 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-02-08T18:12:13.555 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.591 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.074) 0:06:57.818 ***** 2020-02-08T18:12:13.619 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-02-08T18:12:13.621 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.666 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.074) 0:06:57.892 ***** 2020-02-08T18:12:13.691 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-02-08T18:12:13.693 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.727 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.061) 0:06:57.954 ***** 2020-02-08T18:12:13.778 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.823 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.095) 0:06:58.049 ***** 2020-02-08T18:12:13.859 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-02-08T18:12:13.860 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.897 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.074) 0:06:58.124 ***** 2020-02-08T18:12:13.923 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-02-08T18:12:13.924 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:13.959 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:13 +0000 (0:00:00.062) 0:06:58.186 ***** 2020-02-08T18:12:13.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:14.057 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:14 +0000 (0:00:00.097) 0:06:58.284 ***** 2020-02-08T18:12:14.564 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-02-08T18:12:14.566 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-08T18:12:14.613 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:14 +0000 (0:00:00.556) 0:06:58.840 ***** 2020-02-08T18:12:14.928 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-02-08T18:12:14.931 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-02-08 18:04:52 UTC", "ActiveEnterTimestampMonotonic": "13394179", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sntp.service tmp.mount ntpdate.service basic.target sysinit.target system.slice ntpd.service systemd-journald.socket -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-02-08 18:04:50 UTC", "AssertTimestampMonotonic": "12295792", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-02-08 18:04:50 UTC", "ConditionTimestampMonotonic": "12295765", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-02-08T18:12:14.932 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2344", "ExecMainStartTimestamp": "Sat 2020-02-08 18:04:51 UTC", "ExecMainStartTimestampMonotonic": "13350380", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "1844674 2020-02-08T18:12:14.938 INFO:teuthology.task.ansible.out:4073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-02-08 18:04:51 UTC", "InactiveExitTimestampMonotonic": "12454198", "InvocationID": "7bc7b5ba158c4119b36e38c225d5d1ee", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127436", "LimitNPROCSoft": "127436", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127436", "LimitSIGPENDINGSoft": "127436", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2344", "MemoryAccounting": "yes", "MemoryCurrent": "2785280", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdj 2020-02-08T18:12:14.939 INFO:teuthology.task.ansible.out:ust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-02-08 18:04:52 UTC", "StateChangeTimestampMonotonic": "13394179", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", 2020-02-08T18:12:14.941 INFO:teuthology.task.ansible.out: "WatchdogTimestamp": "Sat 2020-02-08 18:04:51 UTC", "WatchdogTimestampMonotonic": "13350394", "WatchdogUSec": "0"}} 2020-02-08T18:12:14.997 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:14 +0000 (0:00:00.383) 0:06:59.223 ***** 2020-02-08T18:12:15.024 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:15.059 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:15 +0000 (0:00:00.062) 0:06:59.286 ***** 2020-02-08T18:12:15.085 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-02-08T18:12:15.086 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:15.122 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:15 +0000 (0:00:00.062) 0:06:59.348 ***** 2020-02-08T18:12:15.147 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-02-08T18:12:15.149 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:15.187 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:15 +0000 (0:00:00.064) 0:06:59.413 ***** 2020-02-08T18:12:15.390 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-02-08T18:12:15.391 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-08T18:12:15.444 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:15 +0000 (0:00:00.256) 0:06:59.670 ***** 2020-02-08T18:12:15.929 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-08T18:12:15.968 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:15 +0000 (0:00:00.524) 0:07:00.195 ***** 2020-02-08T18:12:17.379 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-02-08T18:12:17.381 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-08T18:12:17.431 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:17 +0000 (0:00:01.462) 0:07:01.658 ***** 2020-02-08T18:12:17.457 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:17.500 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:17 +0000 (0:00:00.068) 0:07:01.727 ***** 2020-02-08T18:12:17.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-02-08T18:12:17.539 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-02-08T18:12:17.584 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:17 +0000 (0:00:00.083) 0:07:01.810 ***** 2020-02-08T18:12:17.794 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi157.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-02-08T18:12:17.832 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:17 +0000 (0:00:00.248) 0:07:02.059 ***** 2020-02-08T18:12:17.876 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:17.922 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:17 +0000 (0:00:00.084) 0:07:02.144 ***** 2020-02-08T18:12:17.952 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi157.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-08T18:12:18.000 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:17 +0000 (0:00:00.083) 0:07:02.227 ***** 2020-02-08T18:12:18.030 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.074 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:18 +0000 (0:00:00.067) 0:07:02.295 ***** 2020-02-08T18:12:18.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-08T18:12:18.319 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:18 +0000 (0:00:00.250) 0:07:02.545 ***** 2020-02-08T18:12:18.523 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-02-08T18:12:18.524 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-08T18:12:18.591 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:18 +0000 (0:00:00.271) 0:07:02.817 ***** 2020-02-08T18:12:18.632 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-02-08T18:12:18.633 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.695 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:18 +0000 (0:00:00.101) 0:07:02.919 ***** 2020-02-08T18:12:18.739 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-02-08T18:12:18.740 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.761 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.762 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.786 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.788 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.829 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:18 +0000 (0:00:00.136) 0:07:03.056 ***** 2020-02-08T18:12:18.888 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-08T18:12:18.889 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.891 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.903 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.914 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.928 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:18.990 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:18 +0000 (0:00:00.160) 0:07:03.217 ***** 2020-02-08T18:12:19.029 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-08T18:12:19.030 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.069 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.078) 0:07:03.295 ***** 2020-02-08T18:12:19.095 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-02-08T18:12:19.096 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.148 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.079) 0:07:03.375 ***** 2020-02-08T18:12:19.174 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-02-08T18:12:19.176 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.231 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.083) 0:07:03.458 ***** 2020-02-08T18:12:19.271 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-02-08T18:12:19.273 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.313 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.081) 0:07:03.540 ***** 2020-02-08T18:12:19.339 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-02-08T18:12:19.341 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.386 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.066) 0:07:03.606 ***** 2020-02-08T18:12:19.407 INFO:teuthology.task.ansible.out: 2020-02-08T18:12:19.411 INFO:teuthology.task.ansible.out:TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.462 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.082) 0:07:03.689 ***** 2020-02-08T18:12:19.491 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-02-08T18:12:19.492 INFO:teuthology.task.ansible.out:skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.549 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.084) 0:07:03.773 ***** 2020-02-08T18:12:19.595 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi157.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-08T18:12:19.647 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:19 +0000 (0:00:00.100) 0:07:03.874 ***** 2020-02-08T18:12:19.890 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-08T18:12:19.891 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005049", "end": "2020-02-08 18:12:19.850395", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-08 18:12:19.845346", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:21.100 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.004111", "end": "2020-02-08 18:12:21.050621", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-08 18:12:20.046510", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:21.303 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002799", "end": "2020-02-08 18:12:21.265769", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-08 18:12:21.262970", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:21.533 INFO:teuthology.task.ansible.out:ok: [smithi157.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.033600", "end": "2020-02-08 18:12:21.502865", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-08 18:12:21.469265", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-08T18:12:21.594 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:21 +0000 (0:00:01.947) 0:07:05.821 ***** 2020-02-08T18:12:21.633 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-02-08T18:12:21.680 INFO:teuthology.task.ansible.out:Saturday 08 February 2020 18:12:21 +0000 (0:00:00.085) 0:07:05.907 ***** 2020-02-08T18:12:21.895 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-02-08T18:12:21.897 INFO:teuthology.task.ansible.out:changed: [smithi157.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-08T18:12:22.033 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-02-08T18:12:22.035 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-02-08T18:12:22.042 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi157.front.sepia.ceph.com : ok=129 changed=47 unreachable=0 failed=0 skipped=152 rescued=0 ignored=4 Saturday 08 February 2020 18:12:22 +0000 (0:00:00.359) 0:07:06.267 ***** =============================================================================== 2020-02-08T18:12:22.047 INFO:teuthology.task.ansible.out:testnode : Install packages ------------------------------------------- 107.29s 2020-02-08T18:12:22.049 INFO:teuthology.task.ansible.out:testnode : Base group workaround for BZ1782899 ------------------------- 34.61s users : Update authorized_keys using the keys repo --------------------- 31.39s users : Create all admin users with sudo access. ----------------------- 29.65s users : Remove revoked users ------------------------------------------- 21.23s common : nrpe - Remove SELinux policy package -------------------------- 16.34s common : nrpe - Load SELinux policy package ---------------------------- 16.28s common : Install Kerberos Packages (RedHat) ---------------------------- 13.28s common : Enable necessary rhsm repos ----------------------------------- 11.93s common : Get list of enabled RHSM repos --------------------------------- 9.61s testnode : Ensure ceph packages are not present. ------------------------ 9.15s common : Register with subscription-manager. ---------------------------- 8.93s testnode : Zap all non-root disks --------------------------------------- 8.12s common : nrpe - Install SELinux dependencies ---------------------------- 7.37s common : Disable all rhsm repos ----------------------------------------- 5.63s testnode : Install epel packages ---------------------------------------- 5.61s testnode : Ensure ceph dependency packages are not present. ------------- 5.21s Gathering Facts --------------------------------------------------------- 2.67s users : Update authorized_keys for each user with literal keys ---------- 2.22s testnode : Create logical volume(s) ------------------------------------- 2.19s 2020-02-08T18:12:22.347 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2020-02-08T18:12:22.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-08T18:12:22.350 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi157.front.sepia.ceph.com', 'timeout': 60} 2020-02-08T18:12:22.427 INFO:teuthology.orchestra.run.smithi157:> true 2020-02-08T18:12:22.515 INFO:teuthology.run_tasks:Running task clock... 2020-02-08T18:12:22.530 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-02-08T18:12:22.531 INFO:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-08T18:12:22.594 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-08T18:12:22.610 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-08T18:12:22.654 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2020-02-08T18:12:22.667 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2020-02-08T18:12:22.684 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-08T18:12:22.702 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-08T18:12:22.765 INFO:teuthology.orchestra.run.smithi157.stderr:bash: ntpq: command not found 2020-02-08T18:12:22.766 INFO:teuthology.orchestra.run.smithi157.stdout:210 Number of sources = 4 2020-02-08T18:12:22.766 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-08T18:12:22.766 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2020-02-08T18:12:22.767 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-08T18:12:22.767 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-08T18:12:22.767 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-08T18:12:22.767 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-08T18:12:22.768 INFO:teuthology.run_tasks:Running task install... 2020-02-08T18:12:22.795 DEBUG:teuthology.task.install:project ceph 2020-02-08T18:12:22.795 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'f366546002698478e7b1888bb3d9023bb85c3032'}} 2020-02-08T18:12:22.795 DEBUG:teuthology.task.install:config {'sha1': 'f366546002698478e7b1888bb3d9023bb85c3032'} 2020-02-08T18:12:22.795 INFO:teuthology.task.install:Using flavor: basic 2020-02-08T18:12:22.811 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-02-08T18:12:22.811 INFO:teuthology.task.install:extra packages: [] 2020-02-08T18:12:22.811 INFO:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2020-02-08T18:12:22.851 INFO:teuthology.orchestra.run.smithi157.stdout:RedHatEnterprise 2020-02-08T18:12:22.851 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-02-08T18:12:22.852 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'f366546002698478e7b1888bb3d9023bb85c3032', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-02-08T18:12:22.852 INFO:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2020-02-08T18:12:22.926 INFO:teuthology.orchestra.run.smithi157.stdout:RedHatEnterprise 2020-02-08T18:12:22.927 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-02-08T18:12:22.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f366546002698478e7b1888bb3d9023bb85c3032 2020-02-08T18:12:23.099 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-sage2-testing-2020-02-08-0831/f366546002698478e7b1888bb3d9023bb85c3032/centos/8/flavors/default/ 2020-02-08T18:12:23.099 INFO:teuthology.task.install.rpm:Package version is 15.1.0-405.gf366546 2020-02-08T18:12:23.607 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-08T18:12:23.671 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-02-08T18:12:23.671 INFO:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f366546002698478e7b1888bb3d9023bb85c3032/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-08T18:12:23.749 INFO:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-08T18:12:23.833 INFO:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-08T18:12:23.901 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2020-02-08T18:12:23.902 INFO:teuthology.orchestra.run.smithi157:> sudo yum clean all 2020-02-08T18:12:24.274 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:12:24.750 INFO:teuthology.orchestra.run.smithi157.stdout:224 files removed 2020-02-08T18:12:24.799 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw 2020-02-08T18:12:25.127 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:12:25.848 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 305 kB/s | 69 kB 00:00 2020-02-08T18:12:26.053 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 67 kB/s | 12 kB 00:00 2020-02-08T18:12:26.255 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2020-02-08T18:12:26.694 INFO:teuthology.orchestra.run.smithi157.stdout:Copr repo for ceph-el8 owned by ktdreyer 90 kB/s | 38 kB 00:00 2020-02-08T18:12:27.576 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 5.6 MB 00:00 2020-02-08T18:12:28.724 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 5.6 MB/s | 33 kB 00:00 2020-02-08T18:12:28.929 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 MB/s | 14 MB 00:00 2020-02-08T18:12:31.041 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 80 MB/s | 14 MB 00:00 2020-02-08T18:12:34.610 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:12:34.613 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:12:34.613 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2020-02-08T18:12:34.613 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:12:34.613 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:12:34.613 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:15.1.0-405.gf366546.el8 ceph 9.7 M 2020-02-08T18:12:34.613 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:15.1.0-405.gf366546.el8 ceph 3.6 M 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:15.1.0-405.gf366546.el8 ceph 1.9 M 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:15.1.0-405.gf366546.el8 ceph 5.5 M 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:15.1.0-405.gf366546.el8 ceph 21 M 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:15.1.0-405.gf366546.el8 ceph 25 k 2020-02-08T18:12:34.614 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:15.1.0-405.gf366546.el8 ceph 507 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:15.1.0-405.gf366546.el8 ceph 377 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:15.1.0-405.gf366546.el8 ceph 6.2 M 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:15.1.0-405.gf366546.el8 ceph 40 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:15.1.0-405.gf366546.el8 ceph 51 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:15.1.0-405.gf366546.el8 ceph 149 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:15.1.0-405.gf366546.el8 ceph 351 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:15.1.0-405.gf366546.el8 ceph 309 k 2020-02-08T18:12:34.615 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:15.1.0-405.gf366546.el8 ceph 113 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb x86_64 1.21-2.el8 lab-extras 179 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.8.1-11.el8 lab-extras 257 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: 47 k 2020-02-08T18:12:34.616 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout: 44 k 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout: 353 k 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:12:34.617 INFO:teuthology.orchestra.run.smithi157.stdout:Install 21 Packages 2020-02-08T18:12:34.618 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2020-02-08T18:12:34.618 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:12:34.618 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 51 M 2020-02-08T18:12:34.618 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:12:35.235 INFO:teuthology.orchestra.run.smithi157.stdout:(1/23): ceph-base-15.1.0-405.gf366546.el8.x86_6 8.8 MB/s | 5.5 MB 00:00 2020-02-08T18:12:35.271 INFO:teuthology.orchestra.run.smithi157.stdout:(2/23): ceph-selinux-15.1.0-405.gf366546.el8.x8 697 kB/s | 25 kB 00:00 2020-02-08T18:12:35.326 INFO:teuthology.orchestra.run.smithi157.stdout:(3/23): libcephfs2-15.1.0-405.gf366546.el8.x86_ 9.2 MB/s | 507 kB 00:00 2020-02-08T18:12:35.374 INFO:teuthology.orchestra.run.smithi157.stdout:(4/23): libradosstriper1-15.1.0-405.gf366546.el 7.6 MB/s | 377 kB 00:00 2020-02-08T18:12:36.004 INFO:teuthology.orchestra.run.smithi157.stdout:(5/23): librgw2-15.1.0-405.gf366546.el8.x86_64. 9.8 MB/s | 6.2 MB 00:00 2020-02-08T18:12:36.064 INFO:teuthology.orchestra.run.smithi157.stdout:(6/23): ceph-radosgw-15.1.0-405.gf366546.el8.x8 6.7 MB/s | 9.7 MB 00:01 2020-02-08T18:12:36.064 INFO:teuthology.orchestra.run.smithi157.stdout:(7/23): python3-ceph-argparse-15.1.0-405.gf3665 663 kB/s | 40 kB 00:00 2020-02-08T18:12:36.101 INFO:teuthology.orchestra.run.smithi157.stdout:(8/23): python3-ceph-common-15.1.0-405.gf366546 1.4 MB/s | 51 kB 00:00 2020-02-08T18:12:36.104 INFO:teuthology.orchestra.run.smithi157.stdout:(9/23): python3-cephfs-15.1.0-405.gf366546.el8. 3.6 MB/s | 149 kB 00:00 2020-02-08T18:12:36.143 INFO:teuthology.orchestra.run.smithi157.stdout:(10/23): python3-rados-15.1.0-405.gf366546.el8. 8.4 MB/s | 351 kB 00:00 2020-02-08T18:12:36.154 INFO:teuthology.orchestra.run.smithi157.stdout:(11/23): python3-rbd-15.1.0-405.gf366546.el8.x8 6.4 MB/s | 309 kB 00:00 2020-02-08T18:12:36.177 INFO:teuthology.orchestra.run.smithi157.stdout:(12/23): python3-rgw-15.1.0-405.gf366546.el8.x8 3.0 MB/s | 113 kB 00:00 2020-02-08T18:12:36.252 INFO:teuthology.orchestra.run.smithi157.stdout:(13/23): liboath-2.6.2-3.el8.x86_64.rpm 789 kB/s | 59 kB 00:00 2020-02-08T18:12:36.259 INFO:teuthology.orchestra.run.smithi157.stdout:(14/23): gperftools-libs-2.7-6.el8.x86_64.rpm 2.9 MB/s | 315 kB 00:00 2020-02-08T18:12:36.263 INFO:teuthology.orchestra.run.smithi157.stdout:(15/23): leveldb-1.21-2.el8.x86_64.rpm 40 MB/s | 179 kB 00:00 2020-02-08T18:12:36.266 INFO:teuthology.orchestra.run.smithi157.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 80 MB/s | 257 kB 00:00 2020-02-08T18:12:36.386 INFO:teuthology.orchestra.run.smithi157.stdout:(17/23): ceph-common-15.1.0-405.gf366546.el8.x8 12 MB/s | 21 MB 00:01 2020-02-08T18:12:36.390 INFO:teuthology.orchestra.run.smithi157.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 541 kB/s | 75 kB 00:00 2020-02-08T18:12:36.420 INFO:teuthology.orchestra.run.smithi157.stdout:(19/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 305 kB/s | 47 kB 00:00 2020-02-08T18:12:36.439 INFO:teuthology.orchestra.run.smithi157.stdout:(20/23): python3-prettytable-0.7.2-14.el8.noarc 907 kB/s | 44 kB 00:00 2020-02-08T18:12:36.444 INFO:teuthology.orchestra.run.smithi157.stdout:(21/23): librdkafka-0.11.4-1.el8.x86_64.rpm 6.5 MB/s | 353 kB 00:00 2020-02-08T18:12:36.559 INFO:teuthology.orchestra.run.smithi157.stdout:(22/23): librbd1-15.1.0-405.gf366546.el8.x86_64 16 MB/s | 1.9 MB 00:00 2020-02-08T18:12:36.635 INFO:teuthology.orchestra.run.smithi157.stdout:(23/23): librados2-15.1.0-405.gf366546.el8.x86_ 17 MB/s | 3.6 MB 00:00 2020-02-08T18:12:36.640 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:12:36.641 INFO:teuthology.orchestra.run.smithi157.stdout:Total 25 MB/s | 51 MB 00:02 2020-02-08T18:12:36.647 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:12:36.685 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:12:36.685 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:12:36.962 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:12:36.962 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:12:37.954 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:12:38.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 1/25 2020-02-08T18:12:38.544 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 1/25 2020-02-08T18:12:38.738 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:15.1.0-405.gf366546.el8.x86_64 2/25 2020-02-08T18:12:38.832 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:15.1.0-405.gf366546.el8.x86_64 2/25 2020-02-08T18:12:39.010 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:15.1.0-405.gf366546.el8.x86_64 3/25 2020-02-08T18:12:39.204 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/25 2020-02-08T18:12:39.396 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:15.1.0-405.gf366546.el8.x86_64 5/25 2020-02-08T18:12:39.632 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:15.1.0-405.gf366546.el8.x86_64 5/25 2020-02-08T18:12:39.896 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:15.1.0-405.gf366546.el8.x86_64 6/25 2020-02-08T18:12:40.001 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:15.1.0-405.gf366546.el8.x86_64 6/25 2020-02-08T18:12:40.154 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 7/25 2020-02-08T18:12:40.250 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 7/25 2020-02-08T18:12:40.970 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 8/25 2020-02-08T18:12:41.162 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:15.1.0-405.gf366546.el8.x86_64 9/25 2020-02-08T18:12:41.234 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:15.1.0-405.gf366546.el8.x86_64 9/25 2020-02-08T18:12:41.363 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:15.1.0-405.gf366546.el8.x8 10/25 2020-02-08T18:12:41.558 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:15.1.0-405.gf366546.el8.x86_64 11/25 2020-02-08T18:12:41.750 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:15.1.0-405.gf366546.el8.x86_64 12/25 2020-02-08T18:12:41.979 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:15.1.0-405.gf366546.el8.x86_64 13/25 2020-02-08T18:12:42.125 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:15.1.0-405.gf366546.el8.x86_64 14/25 2020-02-08T18:12:42.189 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:15.1.0-405.gf366546.el8.x86_64 14/25 2020-02-08T18:12:42.346 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 15/25 2020-02-08T18:12:42.582 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-02-08T18:12:42.836 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-02-08T18:12:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : leveldb-1.21-2.el8.x86_64 18/25 2020-02-08T18:12:43.188 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:15.1.0-405.gf366546.el8.x86_ 19/25 2020-02-08T18:12:46.268 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:15.1.0-405.gf366546.el8.x86_64 20/25 2020-02-08T18:12:46.453 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:15.1.0-405.gf366546.el8.x86_64 20/25 2020-02-08T18:12:47.107 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:15.1.0-405.gf366546.el8.x86_64 20/25 2020-02-08T18:12:47.387 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:15.1.0-405.gf366546.el8.x86_64 21/25 2020-02-08T18:12:47.478 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:15.1.0-405.gf366546.el8.x86_64 21/25 2020-02-08T18:12:47.603 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:15.1.0-405.gf366546.el8.x86_64 22/25 2020-02-08T18:13:03.909 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:15.1.0-405.gf366546.el8.x86_64 22/25 2020-02-08T18:13:03.910 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2020-02-08T18:13:03.910 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2020-02-08T18:13:03.910 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2020-02-08T18:13:03.910 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /run 2020-02-08T18:13:03.910 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2020-02-08T18:13:03.910 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2020-02-08T18:13:03.911 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2020-02-08T18:13:03.911 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2020-02-08T18:13:03.911 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /dev 2020-02-08T18:13:03.911 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:04.985 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:15.1.0-405.gf366546.el8.x86_64 23/25 2020-02-08T18:13:05.071 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-405.gf366546.el8.x86_64 23/25 2020-02-08T18:13:05.071 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-02-08T18:13:05.302 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-02-08T18:13:05.302 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-02-08T18:13:06.017 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-02-08T18:13:06.017 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:15.1.0-405.gf366546.el8.x86_64 1/25 2020-02-08T18:13:06.017 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:15.1.0-405.gf366546.el8.x86_64 2/25 2020-02-08T18:13:06.017 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:15.1.0-405.gf366546.el8.x86_64 3/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:15.1.0-405.gf366546.el8.x86_64 4/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:15.1.0-405.gf366546.el8.x86_64 5/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:15.1.0-405.gf366546.el8.x86_64 6/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:15.1.0-405.gf366546.el8.x86_64 7/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:15.1.0-405.gf366546.el8.x8 8/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:15.1.0-405.gf366546.el8.x86_ 9/25 2020-02-08T18:13:06.018 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:15.1.0-405.gf366546.el8.x86_64 10/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:15.1.0-405.gf366546.el8.x86_64 11/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:15.1.0-405.gf366546.el8.x86_64 12/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:15.1.0-405.gf366546.el8.x86_64 13/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 14/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2020-02-08T18:13:06.019 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : leveldb-1.21-2.el8.x86_64 17/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 18/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 19/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:15.1.0-405.gf366546.el8.x86_64 22/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-02-08T18:13:06.020 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:15.1.0-405.gf366546.el8.x86_64 24/25 2020-02-08T18:13:08.598 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-02-08T18:13:08.598 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:13:08.769 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:08.769 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2020-02-08T18:13:08.769 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.770 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.771 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.771 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.771 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.771 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.771 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.771 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-08T18:13:08.772 INFO:teuthology.orchestra.run.smithi157.stdout: leveldb-1.21-2.el8.x86_64 2020-02-08T18:13:08.773 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-08T18:13:08.773 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-08T18:13:08.773 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-08T18:13:08.773 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-08T18:13:08.773 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:08.773 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:08.951 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-test 2020-02-08T18:13:09.297 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:10.048 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2020-02-08T18:13:10.130 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 67 kB/s | 2.8 kB 00:00 2020-02-08T18:13:10.903 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:10.903 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:15.1.0-405.gf366546.el8 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout: ceph 41 M 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:13:10.904 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-13.el8 lab-extras 69 k 2020-02-08T18:13:10.905 INFO:teuthology.orchestra.run.smithi157.stdout: libxslt x86_64 1.1.32-3.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2020-02-08T18:13:10.905 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-02-08T18:13:10.905 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.3.2-6.el8 rhel-8-for-x86_64-appstream-rpms 298 k 2020-02-08T18:13:10.905 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2020-02-08T18:13:10.905 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:10.905 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:13:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2020-02-08T18:13:10.913 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 42 M 2020-02-08T18:13:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 182 M 2020-02-08T18:13:10.913 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:13:10.914 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): xmlstarlet-1.6.1-13.el8.x86_64.rpm 19 MB/s | 69 kB 00:00 2020-02-08T18:13:10.952 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): libxslt-1.1.32-3.el8.x86_64.rpm 5.6 MB/s | 249 kB 00:00 2020-02-08T18:13:10.958 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): jq-1.5-12.el8.x86_64.rpm 3.7 MB/s | 161 kB 00:00 2020-02-08T18:13:10.974 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): socat-1.7.3.2-6.el8.x86_64.rpm 11 MB/s | 298 kB 00:00 2020-02-08T18:13:10.980 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): oniguruma-6.8.2-1.el8.x86_64.rpm 7.3 MB/s | 188 kB 00:00 2020-02-08T18:13:13.159 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): ceph-test-15.1.0-405.gf366546.el8.x86_64 18 MB/s | 41 MB 00:02 2020-02-08T18:13:13.161 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:13:13.161 INFO:teuthology.orchestra.run.smithi157.stdout:Total 19 MB/s | 42 MB 00:02 2020-02-08T18:13:13.169 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:13:13.191 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:13:13.191 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:13:13.414 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:13:13.414 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:13:13.859 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:13:14.507 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 1/6 2020-02-08T18:13:14.636 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 1/6 2020-02-08T18:13:14.861 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.5-12.el8.x86_64 2/6 2020-02-08T18:13:15.074 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-02-08T18:13:15.259 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 4/6 2020-02-08T18:13:19.204 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 5/6 2020-02-08T18:13:19.461 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:15.1.0-405.gf366546.el8.x86_64 6/6 2020-02-08T18:13:19.661 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-test-2:15.1.0-405.gf366546.el8.x86_64 6/6 2020-02-08T18:13:19.661 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:15.1.0-405.gf366546.el8.x86_64 1/6 2020-02-08T18:13:19.661 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 2/6 2020-02-08T18:13:19.662 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 3/6 2020-02-08T18:13:19.662 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.5-12.el8.x86_64 4/6 2020-02-08T18:13:19.662 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 5/6 2020-02-08T18:13:21.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 6/6 2020-02-08T18:13:21.872 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:13:22.076 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:22.076 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:13:22.076 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:15.1.0-405.gf366546.el8.x86_64 xmlstarlet-1.6.1-13.el8.x86_64 2020-02-08T18:13:22.076 INFO:teuthology.orchestra.run.smithi157.stdout: libxslt-1.1.32-3.el8.x86_64 jq-1.5-12.el8.x86_64 2020-02-08T18:13:22.076 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.3.2-6.el8.x86_64 oniguruma-6.8.2-1.el8.x86_64 2020-02-08T18:13:22.076 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:22.077 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:22.282 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph 2020-02-08T18:13:22.615 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:23.187 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2020-02-08T18:13:23.257 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2020-02-08T18:13:23.976 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:23.979 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:23.979 INFO:teuthology.orchestra.run.smithi157.stdout: Package ArchVersion Repository Size 2020-02-08T18:13:23.979 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_642:15.1.0-405.gf366546.el8 ceph 6.4 k 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_642:15.1.0-405.gf366546.el8 ceph 2.0 M 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_642:15.1.0-405.gf366546.el8 ceph 1.6 M 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_642:15.1.0-405.gf366546.el8 ceph 4.3 M 2020-02-08T18:13:23.980 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_642:15.1.0-405.gf366546.el8 ceph 17 M 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-08T18:13:23.981 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-08T18:13:23.982 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webencodings noarch0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml x86_644.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-02-08T18:13:23.983 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_640.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib noarch1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:13:23.984 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:23.985 INFO:teuthology.orchestra.run.smithi157.stdout:Install 31 Packages 2020-02-08T18:13:23.985 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:23.985 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 29 M 2020-02-08T18:13:23.986 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 103 M 2020-02-08T18:13:23.987 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:13:24.072 INFO:teuthology.orchestra.run.smithi157.stdout:(1/31): ceph-15.1.0-405.gf366546.el8.x86_64.rpm 72 kB/s | 6.4 kB 00:00 2020-02-08T18:13:24.301 INFO:teuthology.orchestra.run.smithi157.stdout:(2/31): ceph-mds-15.1.0-405.gf366546.el8.x86_64 6.4 MB/s | 2.0 MB 00:00 2020-02-08T18:13:24.305 INFO:teuthology.orchestra.run.smithi157.stdout:(3/31): ceph-mgr-15.1.0-405.gf366546.el8.x86_64 4.9 MB/s | 1.6 MB 00:00 2020-02-08T18:13:24.364 INFO:teuthology.orchestra.run.smithi157.stdout:(4/31): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.4 MB/s | 145 kB 00:00 2020-02-08T18:13:24.386 INFO:teuthology.orchestra.run.smithi157.stdout:(5/31): python3-cherrypy-18.4.0-1.el8.noarch.rp 18 MB/s | 385 kB 00:00 2020-02-08T18:13:24.394 INFO:teuthology.orchestra.run.smithi157.stdout:(6/31): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-02-08T18:13:24.402 INFO:teuthology.orchestra.run.smithi157.stdout:(7/31): python3-jaraco-functools-2.0-4.el8.noar 2.1 MB/s | 18 kB 00:00 2020-02-08T18:13:24.411 INFO:teuthology.orchestra.run.smithi157.stdout:(8/31): python3-logutils-0.3.5-11.el8.noarch.rp 5.8 MB/s | 49 kB 00:00 2020-02-08T18:13:24.420 INFO:teuthology.orchestra.run.smithi157.stdout:(9/31): python3-more-itertools-7.2.0-3.el8.noar 6.6 MB/s | 59 kB 00:00 2020-02-08T18:13:24.432 INFO:teuthology.orchestra.run.smithi157.stdout:(10/31): python3-pecan-1.3.2-9.el8.noarch.rpm 22 MB/s | 283 kB 00:00 2020-02-08T18:13:24.441 INFO:teuthology.orchestra.run.smithi157.stdout:(11/31): python3-portend-2.6-1.el8.noarch.rpm 2.0 MB/s | 16 kB 00:00 2020-02-08T18:13:24.449 INFO:teuthology.orchestra.run.smithi157.stdout:(12/31): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-02-08T18:13:24.459 INFO:teuthology.orchestra.run.smithi157.stdout:(13/31): python3-singledispatch-3.4.0.3-18.el8. 2.5 MB/s | 24 kB 00:00 2020-02-08T18:13:24.467 INFO:teuthology.orchestra.run.smithi157.stdout:(14/31): python3-tempora-1.14.1-5.el8.noarch.rp 3.5 MB/s | 30 kB 00:00 2020-02-08T18:13:24.477 INFO:teuthology.orchestra.run.smithi157.stdout:(15/31): python3-trustme-0.5.2-4.el8.noarch.rpm 2.7 MB/s | 27 kB 00:00 2020-02-08T18:13:24.487 INFO:teuthology.orchestra.run.smithi157.stdout:(16/31): python3-zc-lockfile-2.0-2.el8.noarch.r 2.4 MB/s | 23 kB 00:00 2020-02-08T18:13:24.553 INFO:teuthology.orchestra.run.smithi157.stdout:(17/31): ceph-mon-15.1.0-405.gf366546.el8.x86_6 9.0 MB/s | 4.3 MB 00:00 2020-02-08T18:13:24.554 INFO:teuthology.orchestra.run.smithi157.stdout:(18/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 651 kB/s | 44 kB 00:00 2020-02-08T18:13:24.602 INFO:teuthology.orchestra.run.smithi157.stdout:(19/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.8 MB/s | 185 kB 00:00 2020-02-08T18:13:24.602 INFO:teuthology.orchestra.run.smithi157.stdout:(20/31): python3-cssselect-0.9.2-10.el8.noarch. 833 kB/s | 40 kB 00:00 2020-02-08T18:13:24.634 INFO:teuthology.orchestra.run.smithi157.stdout:(21/31): python3-waitress-1.2.1-2.el8.1.noarch. 7.4 MB/s | 241 kB 00:00 2020-02-08T18:13:24.648 INFO:teuthology.orchestra.run.smithi157.stdout:(22/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 5.3 MB/s | 251 kB 00:00 2020-02-08T18:13:24.651 INFO:teuthology.orchestra.run.smithi157.stdout:(23/31): python3-webtest-2.0.33-1.el8.noarch.rp 5.0 MB/s | 85 kB 00:00 2020-02-08T18:13:24.688 INFO:teuthology.orchestra.run.smithi157.stdout:(24/31): python3-webencodings-0.5.1-6.el8.noarc 709 kB/s | 27 kB 00:00 2020-02-08T18:13:24.711 INFO:teuthology.orchestra.run.smithi157.stdout:(25/31): python3-lxml-4.2.3-1.el8.x86_64.rpm 25 MB/s | 1.5 MB 00:00 2020-02-08T18:13:24.715 INFO:teuthology.orchestra.run.smithi157.stdout:(26/31): python3-werkzeug-0.12.2-4.el8.noarch.r 16 MB/s | 457 kB 00:00 2020-02-08T18:13:24.740 INFO:teuthology.orchestra.run.smithi157.stdout:(27/31): python3-mako-1.0.6-13.el8.noarch.rpm 5.3 MB/s | 157 kB 00:00 2020-02-08T18:13:24.962 INFO:teuthology.orchestra.run.smithi157.stdout:(28/31): python3-html5lib-0.999999999-6.el8.noa 7.0 MB/s | 214 kB 00:00 2020-02-08T18:13:24.963 INFO:teuthology.orchestra.run.smithi157.stdout:(29/31): python3-pytz-2017.2-9.el8.noarch.rpm 2.4 MB/s | 54 kB 00:00 2020-02-08T18:13:24.963 INFO:teuthology.orchestra.run.smithi157.stdout:(30/31): python3-markupsafe-0.23-19.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2020-02-08T18:13:25.059 INFO:teuthology.orchestra.run.smithi157.stdout:(31/31): ceph-osd-15.1.0-405.gf366546.el8.x86_6 22 MB/s | 17 MB 00:00 2020-02-08T18:13:25.061 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:13:25.061 INFO:teuthology.orchestra.run.smithi157.stdout:Total 27 MB/s | 29 MB 00:01 2020-02-08T18:13:25.080 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:13:25.115 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:13:25.115 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:13:25.333 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:13:25.334 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:13:26.450 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:13:26.667 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/31 2020-02-08T18:13:26.800 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 2/31 2020-02-08T18:13:27.043 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/31 2020-02-08T18:13:27.276 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/31 2020-02-08T18:13:27.533 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 5/31 2020-02-08T18:13:27.716 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/31 2020-02-08T18:13:27.941 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/31 2020-02-08T18:13:28.194 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/31 2020-02-08T18:13:28.407 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 9/31 2020-02-08T18:13:28.706 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 10/31 2020-02-08T18:13:28.984 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 11/31 2020-02-08T18:13:29.205 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 12/31 2020-02-08T18:13:29.380 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 13/31 2020-02-08T18:13:29.620 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2020-02-08T18:13:29.804 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 15/31 2020-02-08T18:13:30.019 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 16/31 2020-02-08T18:13:30.175 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 17/31 2020-02-08T18:13:30.323 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 18/31 2020-02-08T18:13:30.648 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 19/31 2020-02-08T18:13:30.915 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 20/31 2020-02-08T18:13:31.051 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 21/31 2020-02-08T18:13:31.249 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 22/31 2020-02-08T18:13:31.464 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 23/31 2020-02-08T18:13:31.626 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 24/31 2020-02-08T18:13:31.896 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-2.6-1.el8.noarch 25/31 2020-02-08T18:13:32.304 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 26/31 2020-02-08T18:13:32.521 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:15.1.0-405.gf366546.el8.x86_64 27/31 2020-02-08T18:13:33.929 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:15.1.0-405.gf366546.el8.x86_64 27/31 2020-02-08T18:13:34.195 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:15.1.0-405.gf366546.el8.x86_64 28/31 2020-02-08T18:13:34.581 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:15.1.0-405.gf366546.el8.x86_64 28/31 2020-02-08T18:13:34.779 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:15.1.0-405.gf366546.el8.x86_64 29/31 2020-02-08T18:13:34.972 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:15.1.0-405.gf366546.el8.x86_64 29/31 2020-02-08T18:13:35.145 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:15.1.0-405.gf366546.el8.x86_64 30/31 2020-02-08T18:13:35.165 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:15.1.0-405.gf366546.el8.x86_64 30/31 2020-02-08T18:13:35.292 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:15.1.0-405.gf366546.el8.x86_64 31/31 2020-02-08T18:13:35.592 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-2:15.1.0-405.gf366546.el8.x86_64 31/31 2020-02-08T18:13:35.593 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:15.1.0-405.gf366546.el8.x86_64 1/31 2020-02-08T18:13:35.593 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:15.1.0-405.gf366546.el8.x86_64 2/31 2020-02-08T18:13:35.593 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:15.1.0-405.gf366546.el8.x86_64 3/31 2020-02-08T18:13:35.594 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:15.1.0-405.gf366546.el8.x86_64 4/31 2020-02-08T18:13:35.594 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:15.1.0-405.gf366546.el8.x86_64 5/31 2020-02-08T18:13:35.594 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 6/31 2020-02-08T18:13:35.594 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 7/31 2020-02-08T18:13:35.594 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 8/31 2020-02-08T18:13:35.595 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2020-02-08T18:13:35.595 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 10/31 2020-02-08T18:13:35.595 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 11/31 2020-02-08T18:13:35.595 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 12/31 2020-02-08T18:13:35.595 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-2.6-1.el8.noarch 13/31 2020-02-08T18:13:35.596 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 14/31 2020-02-08T18:13:35.596 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 15/31 2020-02-08T18:13:35.596 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 16/31 2020-02-08T18:13:35.596 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 17/31 2020-02-08T18:13:35.597 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 18/31 2020-02-08T18:13:35.597 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 19/31 2020-02-08T18:13:35.597 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 20/31 2020-02-08T18:13:35.597 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 21/31 2020-02-08T18:13:35.597 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/31 2020-02-08T18:13:35.598 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/31 2020-02-08T18:13:35.606 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/31 2020-02-08T18:13:35.606 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 25/31 2020-02-08T18:13:35.606 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 26/31 2020-02-08T18:13:35.607 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 27/31 2020-02-08T18:13:35.607 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 28/31 2020-02-08T18:13:35.607 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 29/31 2020-02-08T18:13:35.607 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 30/31 2020-02-08T18:13:38.545 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 31/31 2020-02-08T18:13:38.546 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:13:38.748 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:38.749 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:13:38.749 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:38.749 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-08T18:13:38.749 INFO:teuthology.orchestra.run.smithi157.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-08T18:13:38.749 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:38.749 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-08T18:13:38.750 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-2.6-1.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-08T18:13:38.751 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-08T18:13:38.752 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-08T18:13:38.753 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-08T18:13:38.753 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-08T18:13:38.753 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-08T18:13:38.753 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:38.753 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:38.929 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-base 2020-02-08T18:13:39.299 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:39.966 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 kB/s | 2.4 kB 00:00 2020-02-08T18:13:40.036 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2020-02-08T18:13:40.618 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-base-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:13:40.795 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:40.796 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:13:40.796 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:40.932 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install cephadm 2020-02-08T18:13:41.276 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:42.405 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 kB/s | 2.4 kB 00:00 2020-02-08T18:13:42.491 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 kB/s | 2.8 kB 00:00 2020-02-08T18:13:43.212 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:43.213 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:43.213 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2020-02-08T18:13:43.213 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:43.214 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:13:43.214 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm x86_64 2:15.1.0-405.gf366546.el8 ceph 32 k 2020-02-08T18:13:43.214 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:43.214 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:13:43.215 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:43.215 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:13:43.215 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:43.215 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 32 k 2020-02-08T18:13:43.216 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 112 k 2020-02-08T18:13:43.216 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:13:43.327 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm-15.1.0-405.gf366546.el8.x86_64.rpm 291 kB/s | 32 kB 00:00 2020-02-08T18:13:43.327 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:13:43.327 INFO:teuthology.orchestra.run.smithi157.stdout:Total 287 kB/s | 32 kB 00:00 2020-02-08T18:13:43.328 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:13:43.335 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:13:43.335 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:13:43.336 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:13:43.337 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:13:43.383 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:13:44.673 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:13:44.948 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:13:47.317 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:13:47.318 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:13:47.502 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:47.503 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:13:47.503 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:47.503 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:47.503 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:47.645 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-immutable-object-cache 2020-02-08T18:13:47.995 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:48.632 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 75 kB/s | 2.4 kB 00:00 2020-02-08T18:13:48.708 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-02-08T18:13:49.778 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:15.1.0-405.gf366546.el8 ceph 203 k 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:49.779 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:13:49.780 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:49.780 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:13:49.780 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:49.780 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 203 k 2020-02-08T18:13:49.781 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 743 k 2020-02-08T18:13:49.781 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:13:49.951 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-immutable-object-cache-15.1.0-405.gf366546 1.2 MB/s | 203 kB 00:00 2020-02-08T18:13:49.952 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:13:49.952 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.1 MB/s | 203 kB 00:00 2020-02-08T18:13:49.954 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:13:49.966 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:13:49.967 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:13:50.015 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:13:50.016 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:13:50.127 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:13:50.298 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-405.gf366546.el 1/1 2020-02-08T18:13:50.645 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-405.gf366546.el 1/1 2020-02-08T18:13:52.793 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-405.gf366546.el 1/1 2020-02-08T18:13:52.794 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:13:52.980 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:52.981 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:13:52.981 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:13:52.981 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:52.981 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:53.129 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr 2020-02-08T18:13:53.472 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:54.122 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 kB/s | 2.4 kB 00:00 2020-02-08T18:13:54.199 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 69 kB/s | 2.8 kB 00:00 2020-02-08T18:13:54.798 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-mgr-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:13:54.980 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:54.980 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:13:54.981 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:13:55.103 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-dashboard 2020-02-08T18:13:55.478 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:13:56.095 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2020-02-08T18:13:56.167 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2020-02-08T18:13:56.907 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:13:56.908 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:56.908 INFO:teuthology.orchestra.run.smithi157.stdout: Package ArchVersion Repository Size 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch2:15.1.0-405.gf366546.el8 ceph-noarch 3.8 M 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch2:15.1.0-405.gf366546.el8 ceph-noarch 22 k 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-08T18:13:56.909 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-08T18:13:56.910 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-02-08T18:13:56.910 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:56.910 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:13:56.910 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:13:56.910 INFO:teuthology.orchestra.run.smithi157.stdout:Install 5 Packages 2020-02-08T18:13:56.910 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:13:56.911 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 4.1 M 2020-02-08T18:13:56.911 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 18 M 2020-02-08T18:13:56.911 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:13:56.961 INFO:teuthology.orchestra.run.smithi157.stdout:(1/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 669 kB/s | 34 kB 00:00 2020-02-08T18:13:57.001 INFO:teuthology.orchestra.run.smithi157.stdout:(2/5): python3-routes-2.4.1-12.el8.noarch.rpm 7.7 MB/s | 197 kB 00:00 2020-02-08T18:13:57.018 INFO:teuthology.orchestra.run.smithi157.stdout:(3/5): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2020-02-08T18:13:57.020 INFO:teuthology.orchestra.run.smithi157.stdout:(4/5): ceph-grafana-dashboards-15.1.0-405.gf366 204 kB/s | 22 kB 00:00 2020-02-08T18:13:57.227 INFO:teuthology.orchestra.run.smithi157.stdout:(5/5): ceph-mgr-dashboard-15.1.0-405.gf366546.e 12 MB/s | 3.8 MB 00:00 2020-02-08T18:13:57.229 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:13:57.229 INFO:teuthology.orchestra.run.smithi157.stdout:Total 13 MB/s | 4.1 MB 00:00 2020-02-08T18:13:57.235 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:13:57.243 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:13:57.243 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:13:57.319 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:13:57.319 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:13:57.585 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:13:57.860 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/5 2020-02-08T18:13:58.064 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/5 2020-02-08T18:13:58.265 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/5 2020-02-08T18:13:59.231 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-405.gf366546.el8.no 4/5 2020-02-08T18:13:59.999 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-405.gf366546.el8.noarch 5/5 2020-02-08T18:14:00.206 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-405.gf366546.el8.noarch 5/5 2020-02-08T18:14:00.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-405.gf366546.el8.no 1/5 2020-02-08T18:14:00.206 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-405.gf366546.el8.noarch 2/5 2020-02-08T18:14:00.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 3/5 2020-02-08T18:14:00.207 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 4/5 2020-02-08T18:14:02.318 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 5/5 2020-02-08T18:14:02.318 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:02.496 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:02.496 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:02.496 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:15.1.0-405.gf366546.el8.noarch 2020-02-08T18:14:02.496 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:15.1.0-405.gf366546.el8.noarch 2020-02-08T18:14:02.496 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-08T18:14:02.497 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-08T18:14:02.497 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-08T18:14:02.497 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:02.497 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:02.649 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-diskprediction-local 2020-02-08T18:14:02.994 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:03.742 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 53 kB/s | 2.4 kB 00:00 2020-02-08T18:14:03.828 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 63 kB/s | 2.8 kB 00:00 2020-02-08T18:14:04.589 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout: Package ArchVersion Repository Size 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-405.gf366546.el8 ceph-noarch 8.6 M 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:14:04.590 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_648.3.1-4.5.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_648.3.1-4.5.el8 rhel-8-for-x86_64-baseos-rpms 638 k 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_641:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_641.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-02-08T18:14:04.591 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:04.592 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:14:04.592 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:04.592 INFO:teuthology.orchestra.run.smithi157.stdout:Install 8 Packages 2020-02-08T18:14:04.592 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:04.592 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 37 M 2020-02-08T18:14:04.593 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 204 M 2020-02-08T18:14:04.593 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:14:04.638 INFO:teuthology.orchestra.run.smithi157.stdout:(1/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 3.6 MB/s | 169 kB 00:00 2020-02-08T18:14:04.649 INFO:teuthology.orchestra.run.smithi157.stdout:(2/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 11 MB/s | 638 kB 00:00 2020-02-08T18:14:04.706 INFO:teuthology.orchestra.run.smithi157.stdout:(3/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 70 MB/s | 4.4 MB 00:00 2020-02-08T18:14:04.734 INFO:teuthology.orchestra.run.smithi157.stdout:(4/8): openblas-0.3.3-2.el8.x86_64.rpm 57 MB/s | 4.3 MB 00:00 2020-02-08T18:14:04.754 INFO:teuthology.orchestra.run.smithi157.stdout:(5/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 8.8 MB/s | 225 kB 00:00 2020-02-08T18:14:04.773 INFO:teuthology.orchestra.run.smithi157.stdout:(6/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 52 MB/s | 3.7 MB 00:00 2020-02-08T18:14:04.950 INFO:teuthology.orchestra.run.smithi157.stdout:(7/8): python3-scipy-1.0.0-20.module+el8.1.0+33 74 MB/s | 15 MB 00:00 2020-02-08T18:14:05.286 INFO:teuthology.orchestra.run.smithi157.stdout:(8/8): ceph-mgr-diskprediction-local-15.1.0-405 12 MB/s | 8.6 MB 00:00 2020-02-08T18:14:05.290 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:14:05.291 INFO:teuthology.orchestra.run.smithi157.stdout:Total 52 MB/s | 37 MB 00:00 2020-02-08T18:14:05.300 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:14:05.322 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:14:05.322 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:14:05.629 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:14:05.629 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:14:06.323 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:14:06.526 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-02-08T18:14:06.649 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-02-08T18:14:06.798 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-02-08T18:14:07.343 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-02-08T18:14:07.523 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-02-08T18:14:08.054 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-02-08T18:14:08.298 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.3-2.el8.x86_64 4/8 2020-02-08T18:14:08.997 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 4/8 2020-02-08T18:14:09.363 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-02-08T18:14:09.589 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-02-08T18:14:11.523 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-02-08T18:14:12.868 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2020-02-08T18:14:13.072 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-405.gf366546. 8/8 2020-02-08T18:14:13.268 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-405.gf366546. 8/8 2020-02-08T18:14:13.269 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-405.gf366546. 1/8 2020-02-08T18:14:13.269 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 2/8 2020-02-08T18:14:13.269 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 3/8 2020-02-08T18:14:13.269 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-02-08T18:14:13.269 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 5/8 2020-02-08T18:14:13.270 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2020-02-08T18:14:13.270 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 7/8 2020-02-08T18:14:15.379 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 8/8 2020-02-08T18:14:15.380 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:15.559 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:15.559 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:15.560 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:15.1.0-405.gf366546.el8.noarch 2020-02-08T18:14:15.560 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-08T18:14:15.560 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-08T18:14:15.560 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-08T18:14:15.560 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-08T18:14:15.561 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-08T18:14:15.561 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-08T18:14:15.561 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-02-08T18:14:15.561 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:15.562 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:15.710 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-rook 2020-02-08T18:14:16.058 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:16.725 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2020-02-08T18:14:16.794 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2020-02-08T18:14:17.535 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:17.535 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:17.535 INFO:teuthology.orchestra.run.smithi157.stdout: Package ArchVersion Repository Size 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch2:15.1.0-405.gf366546.el8 ceph-noarch 17 k 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-08T18:14:17.536 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:17.537 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:14:17.538 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:17.538 INFO:teuthology.orchestra.run.smithi157.stdout:Install 11 Packages 2020-02-08T18:14:17.538 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:17.538 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 1.8 M 2020-02-08T18:14:17.538 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 23 M 2020-02-08T18:14:17.538 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:14:17.593 INFO:teuthology.orchestra.run.smithi157.stdout:(1/11): python3-cachetools-3.1.1-4.el8.noarch.r 571 kB/s | 33 kB 00:00 2020-02-08T18:14:17.593 INFO:teuthology.orchestra.run.smithi157.stdout:(2/11): python3-certifi-2018.10.15-7.el8.noarch 281 kB/s | 16 kB 00:00 2020-02-08T18:14:17.634 INFO:teuthology.orchestra.run.smithi157.stdout:(3/11): python3-google-auth-1.1.1-10.el8.noarch 2.1 MB/s | 81 kB 00:00 2020-02-08T18:14:17.652 INFO:teuthology.orchestra.run.smithi157.stdout:(4/11): ceph-mgr-rook-15.1.0-405.gf366546.el8.n 151 kB/s | 17 kB 00:00 2020-02-08T18:14:17.652 INFO:teuthology.orchestra.run.smithi157.stdout:(5/11): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-02-08T18:14:17.686 INFO:teuthology.orchestra.run.smithi157.stdout:(6/11): python3-requests-oauthlib-1.0.0-1.el8.n 1.2 MB/s | 43 kB 00:00 2020-02-08T18:14:17.707 INFO:teuthology.orchestra.run.smithi157.stdout:(7/11): python3-websocket-client-0.56.0-5.el8.n 995 kB/s | 61 kB 00:00 2020-02-08T18:14:17.709 INFO:teuthology.orchestra.run.smithi157.stdout:(8/11): python3-oauthlib-2.1.0-1.el8.noarch.rpm 6.5 MB/s | 155 kB 00:00 2020-02-08T18:14:17.734 INFO:teuthology.orchestra.run.smithi157.stdout:(9/11): python3-kubernetes-10.0.1-1.el8.noarch. 8.2 MB/s | 1.1 MB 00:00 2020-02-08T18:14:17.742 INFO:teuthology.orchestra.run.smithi157.stdout:(10/11): python3-pyasn1-modules-0.3.7-6.el8.noa 3.3 MB/s | 110 kB 00:00 2020-02-08T18:14:17.750 INFO:teuthology.orchestra.run.smithi157.stdout:(11/11): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2020-02-08T18:14:17.750 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:14:17.751 INFO:teuthology.orchestra.run.smithi157.stdout:Total 8.5 MB/s | 1.8 MB 00:00 2020-02-08T18:14:17.755 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:14:17.770 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:14:17.771 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:14:17.815 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:14:17.815 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:14:18.232 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:14:18.503 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/11 2020-02-08T18:14:18.730 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 2/11 2020-02-08T18:14:18.984 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/11 2020-02-08T18:14:19.235 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/11 2020-02-08T18:14:19.416 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/11 2020-02-08T18:14:19.636 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 6/11 2020-02-08T18:14:19.802 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 7/11 2020-02-08T18:14:20.010 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 8/11 2020-02-08T18:14:21.102 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 9/11 2020-02-08T18:14:21.387 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 10/11 2020-02-08T18:14:21.531 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:15.1.0-405.gf366546.el8.noarch 11/11 2020-02-08T18:14:21.717 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-405.gf366546.el8.noarch 11/11 2020-02-08T18:14:21.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:15.1.0-405.gf366546.el8.noarch 1/11 2020-02-08T18:14:21.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/11 2020-02-08T18:14:21.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/11 2020-02-08T18:14:21.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/11 2020-02-08T18:14:21.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 5/11 2020-02-08T18:14:21.718 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 6/11 2020-02-08T18:14:21.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/11 2020-02-08T18:14:21.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 8/11 2020-02-08T18:14:21.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 9/11 2020-02-08T18:14:21.719 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/11 2020-02-08T18:14:23.971 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 11/11 2020-02-08T18:14:23.972 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:24.161 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:15.1.0-405.gf366546.el8.noarch 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-08T18:14:24.162 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:24.163 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:24.278 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-cephadm 2020-02-08T18:14:24.633 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:25.356 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 kB/s | 2.4 kB 00:00 2020-02-08T18:14:25.422 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 84 kB/s | 2.8 kB 00:00 2020-02-08T18:14:26.142 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:26.142 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout: Package ArchVersion Repository Size 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch2:15.1.0-405.gf366546.el8 ceph-noarch 29 k 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-08T18:14:26.143 INFO:teuthology.orchestra.run.smithi157.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-08T18:14:26.144 INFO:teuthology.orchestra.run.smithi157.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-08T18:14:26.144 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:26.144 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:14:26.149 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:26.149 INFO:teuthology.orchestra.run.smithi157.stdout:Install 4 Packages 2020-02-08T18:14:26.149 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:26.150 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 454 k 2020-02-08T18:14:26.150 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 1.4 M 2020-02-08T18:14:26.150 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:14:26.197 INFO:teuthology.orchestra.run.smithi157.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 913 kB/s | 48 kB 00:00 2020-02-08T18:14:26.213 INFO:teuthology.orchestra.run.smithi157.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 5.0 MB/s | 356 kB 00:00 2020-02-08T18:14:26.254 INFO:teuthology.orchestra.run.smithi157.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 374 kB/s | 21 kB 00:00 2020-02-08T18:14:26.255 INFO:teuthology.orchestra.run.smithi157.stdout:(4/4): ceph-mgr-cephadm-15.1.0-405.gf366546.el8 263 kB/s | 29 kB 00:00 2020-02-08T18:14:26.255 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:14:26.256 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.9 MB/s | 454 kB 00:00 2020-02-08T18:14:26.262 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:14:26.266 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:14:26.267 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:14:26.294 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:14:26.294 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:14:26.445 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:14:26.700 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-02-08T18:14:26.946 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-02-08T18:14:27.168 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-02-08T18:14:27.305 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-405.gf366546.el8.noarch 4/4 2020-02-08T18:14:27.503 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-405.gf366546.el8.noarch 4/4 2020-02-08T18:14:27.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-405.gf366546.el8.noarch 1/4 2020-02-08T18:14:27.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-02-08T18:14:27.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-02-08T18:14:29.692 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-02-08T18:14:29.692 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:29.892 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:29.892 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:29.892 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:15.1.0-405.gf366546.el8.noarch 2020-02-08T18:14:29.893 INFO:teuthology.orchestra.run.smithi157.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-08T18:14:29.894 INFO:teuthology.orchestra.run.smithi157.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-08T18:14:29.894 INFO:teuthology.orchestra.run.smithi157.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-08T18:14:29.894 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:29.894 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:30.010 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-fuse 2020-02-08T18:14:30.396 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:31.062 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 71 kB/s | 2.4 kB 00:00 2020-02-08T18:14:31.136 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 kB/s | 2.8 kB 00:00 2020-02-08T18:14:31.863 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:31.863 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:31.863 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2020-02-08T18:14:31.863 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:31.863 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:14:31.864 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:15.1.0-405.gf366546.el8 ceph 571 k 2020-02-08T18:14:31.864 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2020-02-08T18:14:31.868 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-02-08T18:14:31.868 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-common 2020-02-08T18:14:31.869 INFO:teuthology.orchestra.run.smithi157.stdout: x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-02-08T18:14:31.869 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:31.869 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:14:31.869 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:31.870 INFO:teuthology.orchestra.run.smithi157.stdout:Install 3 Packages 2020-02-08T18:14:31.870 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:31.870 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 675 k 2020-02-08T18:14:31.870 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 2.1 M 2020-02-08T18:14:31.871 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:14:31.913 INFO:teuthology.orchestra.run.smithi157.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2020-02-08T18:14:31.914 INFO:teuthology.orchestra.run.smithi157.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 399 kB/s | 21 kB 00:00 2020-02-08T18:14:32.075 INFO:teuthology.orchestra.run.smithi157.stdout:(3/3): ceph-fuse-15.1.0-405.gf366546.el8.x86_64 2.6 MB/s | 571 kB 00:00 2020-02-08T18:14:32.076 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:14:32.076 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.0 MB/s | 675 kB 00:00 2020-02-08T18:14:32.089 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:14:32.102 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:14:32.102 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:14:32.169 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:14:32.169 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:14:32.367 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:14:32.368 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-02-08T18:14:32.368 INFO:teuthology.orchestra.run.smithi157.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-08T18:14:32.368 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:32.759 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-02-08T18:14:32.933 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:15.1.0-405.gf366546.el8.x86_64 3/3 2020-02-08T18:14:33.235 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-fuse-2:15.1.0-405.gf366546.el8.x86_64 3/3 2020-02-08T18:14:33.235 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:15.1.0-405.gf366546.el8.x86_64 1/3 2020-02-08T18:14:33.236 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-02-08T18:14:35.316 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-02-08T18:14:35.316 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:35.508 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:35.508 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:35.508 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:15.1.0-405.gf366546.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-02-08T18:14:35.508 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-08T18:14:35.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:35.509 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:35.640 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install librados-devel 2020-02-08T18:14:35.995 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:36.702 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 2020-02-08T18:14:36.769 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2020-02-08T18:14:37.663 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:37.664 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:37.664 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2020-02-08T18:14:37.664 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:37.664 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:15.1.0-405.gf366546.el8 ceph 141 k 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 141 k 2020-02-08T18:14:37.665 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 487 k 2020-02-08T18:14:37.666 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:14:37.821 INFO:teuthology.orchestra.run.smithi157.stdout:librados-devel-15.1.0-405.gf366546.el8.x86_64.r 911 kB/s | 141 kB 00:00 2020-02-08T18:14:37.821 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:14:37.821 INFO:teuthology.orchestra.run.smithi157.stdout:Total 903 kB/s | 141 kB 00:00 2020-02-08T18:14:37.824 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:14:37.829 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:14:37.830 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:14:37.882 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:14:37.882 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:14:37.995 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:14:38.194 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:14:38.378 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados-devel-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:14:40.623 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:14:40.624 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:40.817 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:40.818 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:40.818 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:14:40.818 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:40.818 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:40.963 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs2 2020-02-08T18:14:41.325 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:41.844 INFO:teuthology.orchestra.run.smithi157.stdout:Waiting for process with pid 12118 to finish. 2020-02-08T18:14:43.050 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2020-02-08T18:14:43.118 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2020-02-08T18:14:44.257 INFO:teuthology.orchestra.run.smithi157.stdout:Package libcephfs2-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:14:44.437 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:44.446 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:14:44.446 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:44.559 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs-devel 2020-02-08T18:14:44.914 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:45.505 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 2020-02-08T18:14:45.576 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2020-02-08T18:14:46.320 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:46.320 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:46.321 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2020-02-08T18:14:46.321 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:46.321 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:14:46.321 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:15.1.0-405.gf366546.el8 ceph 21 k 2020-02-08T18:14:46.321 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:46.322 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:14:46.322 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:14:46.322 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:14:46.322 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:46.322 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 21 k 2020-02-08T18:14:46.323 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 75 k 2020-02-08T18:14:46.323 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:14:46.424 INFO:teuthology.orchestra.run.smithi157.stdout:libcephfs-devel-15.1.0-405.gf366546.el8.x86_64. 189 kB/s | 21 kB 00:00 2020-02-08T18:14:46.426 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:14:46.426 INFO:teuthology.orchestra.run.smithi157.stdout:Total 187 kB/s | 21 kB 00:00 2020-02-08T18:14:46.428 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:14:46.431 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:14:46.432 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:14:46.433 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:14:46.434 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:14:46.489 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:14:46.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:14:46.800 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs-devel-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:14:48.972 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:14:48.972 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:14:49.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:49.310 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:14:49.310 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:14:49.310 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:14:49.310 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:49.488 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install librados2 2020-02-08T18:14:49.841 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:50.530 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 kB/s | 2.4 kB 00:00 2020-02-08T18:14:50.598 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 80 kB/s | 2.8 kB 00:00 2020-02-08T18:14:51.150 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:14:51.325 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:51.326 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:14:51.326 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:51.470 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install librbd1 2020-02-08T18:14:51.825 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:52.845 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 75 kB/s | 2.4 kB 00:00 2020-02-08T18:14:52.917 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 84 kB/s | 2.8 kB 00:00 2020-02-08T18:14:53.447 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:14:53.626 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:53.626 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:14:53.627 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:53.747 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rados 2020-02-08T18:14:54.106 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:54.735 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2020-02-08T18:14:54.805 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2020-02-08T18:14:55.356 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rados-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:14:55.534 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:55.536 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:14:55.537 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:55.666 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rgw 2020-02-08T18:14:56.017 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:56.763 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 71 kB/s | 2.4 kB 00:00 2020-02-08T18:14:56.835 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 88 kB/s | 2.8 kB 00:00 2020-02-08T18:14:57.413 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rgw-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:14:57.595 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:57.596 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:14:57.596 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:57.743 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-cephfs 2020-02-08T18:14:58.098 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:14:58.747 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 72 kB/s | 2.4 kB 00:00 2020-02-08T18:14:58.820 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2020-02-08T18:14:59.418 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-cephfs-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:14:59.600 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:14:59.603 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:14:59.603 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:14:59.782 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rbd 2020-02-08T18:15:00.134 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:15:00.750 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 76 kB/s | 2.4 kB 00:00 2020-02-08T18:15:00.820 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2020-02-08T18:15:01.387 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rbd-2:15.1.0-405.gf366546.el8.x86_64 is already installed. 2020-02-08T18:15:01.567 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:15:01.568 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2020-02-08T18:15:01.569 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:15:01.711 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-fuse 2020-02-08T18:15:02.066 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:15:02.935 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2020-02-08T18:15:03.004 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2020-02-08T18:15:03.730 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:15:03.731 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:03.731 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:15.1.0-405.gf366546.el8 ceph 72 k 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:03.732 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:15:03.733 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:03.733 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 72 k 2020-02-08T18:15:03.733 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 230 k 2020-02-08T18:15:03.733 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:15:04.023 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-fuse-15.1.0-405.gf366546.el8.x86_64.rpm 247 kB/s | 72 kB 00:00 2020-02-08T18:15:04.024 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:15:04.024 INFO:teuthology.orchestra.run.smithi157.stdout:Total 246 kB/s | 72 kB 00:00 2020-02-08T18:15:04.028 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:15:04.037 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:15:04.037 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:15:04.088 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:15:04.088 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:15:04.211 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:15:04.365 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:04.566 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-fuse-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:06.598 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:06.598 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:15:06.799 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:06.799 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:15:06.799 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:15:06.799 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:06.799 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:15:06.926 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-mirror 2020-02-08T18:15:07.318 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:15:07.877 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 67 kB/s | 2.4 kB 00:00 2020-02-08T18:15:07.938 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2020-02-08T18:15:08.693 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:15:08.693 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:08.694 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2020-02-08T18:15:08.694 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:08.694 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:15:08.694 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:15.1.0-405.gf366546.el8 ceph 2.6 M 2020-02-08T18:15:08.695 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:08.695 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:15:08.695 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:08.695 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:15:08.696 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:08.696 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.6 M 2020-02-08T18:15:08.696 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 12 M 2020-02-08T18:15:08.696 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:15:08.958 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-mirror-15.1.0-405.gf366546.el8.x86_64.rpm 9.7 MB/s | 2.6 MB 00:00 2020-02-08T18:15:08.958 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:15:08.959 INFO:teuthology.orchestra.run.smithi157.stdout:Total 9.6 MB/s | 2.6 MB 00:00 2020-02-08T18:15:08.961 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:15:08.974 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:15:08.974 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:15:09.034 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:15:09.035 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:15:09.382 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:15:09.530 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:09.856 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:12.163 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:12.163 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:15:12.351 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:12.351 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:15:12.351 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:15:12.351 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:12.351 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:15:12.517 INFO:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-nbd 2020-02-08T18:15:12.874 INFO:teuthology.orchestra.run.smithi157.stdout:Updating Subscription Management repositories. 2020-02-08T18:15:13.517 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2020-02-08T18:15:13.610 INFO:teuthology.orchestra.run.smithi157.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 89 kB/s | 2.8 kB 00:00 2020-02-08T18:15:14.367 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2020-02-08T18:15:14.368 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:14.368 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2020-02-08T18:15:14.369 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:14.369 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2020-02-08T18:15:14.369 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:15.1.0-405.gf366546.el8 ceph 141 k 2020-02-08T18:15:14.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:14.370 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2020-02-08T18:15:14.370 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2020-02-08T18:15:14.370 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2020-02-08T18:15:14.370 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:14.371 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 141 k 2020-02-08T18:15:14.371 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 527 k 2020-02-08T18:15:14.371 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2020-02-08T18:15:14.569 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-nbd-15.1.0-405.gf366546.el8.x86_64.rpm 704 kB/s | 141 kB 00:00 2020-02-08T18:15:14.570 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2020-02-08T18:15:14.579 INFO:teuthology.orchestra.run.smithi157.stdout:Total 699 kB/s | 141 kB 00:00 2020-02-08T18:15:14.579 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2020-02-08T18:15:14.583 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2020-02-08T18:15:14.583 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2020-02-08T18:15:14.634 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2020-02-08T18:15:14.634 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2020-02-08T18:15:14.742 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2020-02-08T18:15:14.916 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:15.106 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-nbd-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:17.278 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:15.1.0-405.gf366546.el8.x86_64 1/1 2020-02-08T18:15:17.279 INFO:teuthology.orchestra.run.smithi157.stdout:Installed products updated. 2020-02-08T18:15:17.470 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:17.470 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2020-02-08T18:15:17.470 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:15.1.0-405.gf366546.el8.x86_64 2020-02-08T18:15:17.471 INFO:teuthology.orchestra.run.smithi157.stdout: 2020-02-08T18:15:17.471 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2020-02-08T18:15:17.594 DEBUG:teuthology.parallel:result is None 2020-02-08T18:15:17.595 INFO:teuthology.orchestra.run.smithi157:> sudo lsb_release -is 2020-02-08T18:15:17.636 INFO:teuthology.orchestra.run.smithi157.stdout:RedHatEnterprise 2020-02-08T18:15:17.636 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-02-08T18:15:17.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f366546002698478e7b1888bb3d9023bb85c3032 2020-02-08T18:15:17.811 INFO:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-08T18:15:17.830 INFO:teuthology.orchestra.run.smithi157.stdout:15.1.0-405.gf366546.el8 2020-02-08T18:15:17.830 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-405.gf366546.el8 2020-02-08T18:15:17.831 INFO:teuthology.task.install:The correct ceph version 15.1.0-405.gf366546 is installed. 2020-02-08T18:15:17.831 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-02-08T18:15:17.831 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-08T18:15:17.899 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-02-08T18:15:17.899 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-08T18:15:17.968 INFO:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-08T18:15:18.034 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-02-08T18:15:18.034 INFO:teuthology.orchestra.run.smithi157:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-08T18:15:18.120 INFO:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-08T18:15:18.187 INFO:teuthology.run_tasks:Running task workunit... 2020-02-08T18:15:18.218 INFO:tasks.workunit:Pulling workunits from ref f366546002698478e7b1888bb3d9023bb85c3032 2020-02-08T18:15:18.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-02-08T18:15:18.218 INFO:tasks.workunit:timeout=3h 2020-02-08T18:15:18.219 INFO:tasks.workunit:cleanup=True 2020-02-08T18:15:18.219 INFO:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.0 2020-02-08T18:15:18.242 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-02-08T18:15:18.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-08T18:15:18.242 INFO:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-02-08T18:15:18.302 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-02-08T18:15:18.303 INFO:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-02-08T18:15:18.356 INFO:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f366546002698478e7b1888bb3d9023bb85c3032 2020-02-08T18:15:18.413 INFO:tasks.workunit.client.0.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-02-08T18:16:49.697 INFO:tasks.workunit.client.0.smithi157.stderr:Note: checking out 'f366546002698478e7b1888bb3d9023bb85c3032'. 2020-02-08T18:16:49.698 INFO:tasks.workunit.client.0.smithi157.stderr: 2020-02-08T18:16:49.698 INFO:tasks.workunit.client.0.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-02-08T18:16:49.698 INFO:tasks.workunit.client.0.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2020-02-08T18:16:49.698 INFO:tasks.workunit.client.0.smithi157.stderr:state without impacting any branches by performing another checkout. 2020-02-08T18:16:49.698 INFO:tasks.workunit.client.0.smithi157.stderr: 2020-02-08T18:16:49.699 INFO:tasks.workunit.client.0.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2020-02-08T18:16:49.699 INFO:tasks.workunit.client.0.smithi157.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-02-08T18:16:49.699 INFO:tasks.workunit.client.0.smithi157.stderr: 2020-02-08T18:16:49.699 INFO:tasks.workunit.client.0.smithi157.stderr: git checkout -b 2020-02-08T18:16:49.699 INFO:tasks.workunit.client.0.smithi157.stderr: 2020-02-08T18:16:49.699 INFO:tasks.workunit.client.0.smithi157.stderr:HEAD is now at f366546002 Merge branch 'fix-cephadm-qa' of https://github.com/liewegas/ceph into wip-sage2-testing-2020-02-08-0831 2020-02-08T18:16:49.701 INFO:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-02-08T18:16:49.815 DEBUG:teuthology.orchestra.remote:smithi157:/home/ubuntu/cephtest/workunits.list.client.0 is 1KB 2020-02-08T18:16:49.863 INFO:tasks.workunit:Running workunits matching scrub on client.0... 2020-02-08T18:16:49.863 INFO:tasks.workunit:Running workunit scrub/osd-recovery-scrub.sh... 2020-02-08T18:16:49.863 INFO:teuthology.orchestra.run.smithi157:workunit test scrub/osd-recovery-scrub.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f366546002698478e7b1888bb3d9023bb85c3032 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh 2020-02-08T18:16:49.914 INFO:tasks.workunit.client.0.smithi157.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-02-08T18:16:49.921 INFO:tasks.workunit.client.0.smithi157.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-02-08T18:16:49.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-02-08T18:16:49.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-02-08T18:16:49.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: main: export PYTHONWARNINGS=ignore 2020-02-08T18:16:49.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: main: PYTHONWARNINGS=ignore 2020-02-08T18:16:49.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: main: export CEPH_CONF=/dev/null 2020-02-08T18:16:49.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: main: CEPH_CONF=/dev/null 2020-02-08T18:16:49.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2141: main: unset CEPH_ARGS 2020-02-08T18:16:49.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2143: main: local code 2020-02-08T18:16:49.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: run td/osd-recovery-scrub 2020-02-08T18:16:49.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:20: run: local dir=td/osd-recovery-scrub 2020-02-08T18:16:49.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:21: run: shift 2020-02-08T18:16:49.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:23: run: export CEPH_MON=127.0.0.1:7124 2020-02-08T18:16:49.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:23: run: CEPH_MON=127.0.0.1:7124 2020-02-08T18:16:49.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:24: run: export CEPH_ARGS 2020-02-08T18:16:49.924 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:25: run: uuidgen 2020-02-08T18:16:49.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:25: run: CEPH_ARGS+='--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none ' 2020-02-08T18:16:49.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2020-02-08T18:16:49.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:28: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2020-02-08T18:16:49.940 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:29: run: set 2020-02-08T18:16:49.940 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:29: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:29: run: local funcs=TEST_recovery_scrub 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: for func in $funcs 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:31: run: TEST_recovery_scrub td/osd-recovery-scrub 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:36: TEST_recovery_scrub: local dir=td/osd-recovery-scrub 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:37: TEST_recovery_scrub: local poolname=test 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:39: TEST_recovery_scrub: TESTDATA=testdata.12840 2020-02-08T18:16:49.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:40: TEST_recovery_scrub: OSDS=8 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:41: TEST_recovery_scrub: PGS=32 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:42: TEST_recovery_scrub: OBJECTS=4 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:44: TEST_recovery_scrub: setup td/osd-recovery-scrub 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-recovery-scrub 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-recovery-scrub 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-recovery-scrub 2020-02-08T18:16:49.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-recovery-scrub KILL 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:16:49.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:16:49.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-recovery-scrub 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:49.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.12840 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-recovery-scrub 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:49.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.12840 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-recovery-scrub 1' TERM HUP INT 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:45: TEST_recovery_scrub: run_mon td/osd-recovery-scrub a --osd_pool_default_size=1 2020-02-08T18:16:49.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-recovery-scrub 2020-02-08T18:16:49.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-02-08T18:16:49.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-02-08T18:16:49.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-02-08T18:16:49.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-recovery-scrub/a 2020-02-08T18:16:49.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-recovery-scrub/a --run-dir=td/osd-recovery-scrub --osd_pool_default_size=1 2020-02-08T18:16:50.207 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-02-08T18:16:50.207 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:16:50.207 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:16:50.207 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:16:50.207 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:50.207 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:50.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:16:50.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-recovery-scrub/a '--log-file=td/osd-recovery-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --mon-cluster-log-file=td/osd-recovery-scrub/log --run-dir=td/osd-recovery-scrub '--pid-file=td/osd-recovery-scrub/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --osd_pool_default_size=1 2020-02-08T18:16:50.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: cat 2020-02-08T18:16:50.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a fsid 2020-02-08T18:16:50.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:16:50.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:16:50.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=fsid 2020-02-08T18:16:50.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .fsid 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.12840/ceph-mon.a.asok 2020-02-08T18:16:50.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:16:50.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.12840/ceph-mon.a.asok config get fsid 2020-02-08T18:16:50.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a mon_host 2020-02-08T18:16:50.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:16:50.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:16:50.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=mon_host 2020-02-08T18:16:50.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .mon_host 2020-02-08T18:16:50.437 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.12840/ceph-mon.a.asok 2020-02-08T18:16:50.438 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:16:50.439 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.12840/ceph-mon.a.asok config get mon_host 2020-02-08T18:16:50.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:46: TEST_recovery_scrub: run_mgr td/osd-recovery-scrub x 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:551: run_mgr: local dir=td/osd-recovery-scrub 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: shift 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local id=x 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local data=td/osd-recovery-scrub/x 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: get_asok_path 2020-02-08T18:16:50.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:16:50.525 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:16:50.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:16:50.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:50.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:50.525 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:16:50.525 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:16:50.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-recovery-scrub/x '--log-file=td/osd-recovery-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --run-dir=td/osd-recovery-scrub '--pid-file=td/osd-recovery-scrub/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:16:51.146 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: expr 8 - 1 2020-02-08T18:16:51.146 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: seq 0 7 2020-02-08T18:16:51.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:16:51.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 0 2020-02-08T18:16:51.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:16:51.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:16:51.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=0 2020-02-08T18:16:51.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:16:51.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/0 2020-02-08T18:16:51.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:16:51.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:16:51.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:16:51.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:16:51.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/0' 2020-02-08T18:16:51.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/0/journal' 2020-02-08T18:16:51.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:16:51.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:51.169 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:51.170 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:16:51.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:16:51.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:16:51.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:16:51.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:16:51.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:16:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:16:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:16:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:16:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:16:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:16:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:16:51.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/0 2020-02-08T18:16:51.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:16:51.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=d1de348d-5817-4ebc-b83f-818a2622d8ee 2020-02-08T18:16:51.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd0 d1de348d-5817-4ebc-b83f-818a2622d8ee' 2020-02-08T18:16:51.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:16:51.172 INFO:tasks.workunit.client.0.smithi157.stdout:add osd0 d1de348d-5817-4ebc-b83f-818a2622d8ee 2020-02-08T18:16:51.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQAT+z5e6kR2ChAAlqsZrb1iJiCPqwO8EaZ9CQ== 2020-02-08T18:16:51.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQAT+z5e6kR2ChAAlqsZrb1iJiCPqwO8EaZ9CQ=="}' 2020-02-08T18:16:51.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new d1de348d-5817-4ebc-b83f-818a2622d8ee -i td/osd-recovery-scrub/0/new.json 2020-02-08T18:16:51.466 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:16:51.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/0/new.json 2020-02-08T18:16:51.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 0 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/0 --osd-journal=td/osd-recovery-scrub/0/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAT+z5e6kR2ChAAlqsZrb1iJiCPqwO8EaZ9CQ== --osd-uuid d1de348d-5817-4ebc-b83f-818a2622d8ee 2020-02-08T18:16:51.497 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.494+0000 7fca4fae5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:51.498 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.496+0000 7fca4fae5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:51.501 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.498+0000 7fca4fae5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:51.501 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.499+0000 7fca4fae5ec0 -1 bluestore(td/osd-recovery-scrub/0/block) _read_bdev_label failed to open td/osd-recovery-scrub/0/block: (2) No such file or directory 2020-02-08T18:16:51.502 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.499+0000 7fca4fae5ec0 -1 bluestore(td/osd-recovery-scrub/0/block) _read_bdev_label failed to open td/osd-recovery-scrub/0/block: (2) No such file or directory 2020-02-08T18:16:51.502 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.499+0000 7fca4fae5ec0 -1 bluestore(td/osd-recovery-scrub/0/block) _read_bdev_label failed to open td/osd-recovery-scrub/0/block: (2) No such file or directory 2020-02-08T18:16:51.549 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:51.546+0000 7fca4fae5ec0 -1 bluestore(td/osd-recovery-scrub/0) _read_fsid unparsable uuid 2020-02-08T18:16:54.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/0/keyring 2020-02-08T18:16:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:16:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd0 key to auth repository 2020-02-08T18:16:54.560 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:16:54.561 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd0 key to auth repository 2020-02-08T18:16:54.735 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.0 2020-02-08T18:16:54.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.0 2020-02-08T18:16:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 0 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/0 --osd-journal=td/osd-recovery-scrub/0/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:16:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:16:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:16:54.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:16:54.754 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:54.751+0000 7f7a97a54ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:54.755 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:54.753+0000 7f7a97a54ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:54.757 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:54.755+0000 7f7a97a54ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:54.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 0 2020-02-08T18:16:54.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:16:54.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:16:54.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:16:54.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:16:54.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:16:54.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:16:54.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:16:54.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:16:54.916 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:16:55.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:16:55.277 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:55.272+0000 7f7a97a54ec0 -1 Falling back to public interface 2020-02-08T18:16:55.975 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:55.972+0000 7f7a97a54ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-08T18:16:56.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:16:56.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:16:56.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:16:56.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:16:56.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:16:56.088 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:16:56.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:16:57.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:16:57.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:16:57.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:16:57.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:16:57.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:16:57.351 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:16:57.635 INFO:tasks.workunit.client.0.smithi157.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/13188,v1:127.0.0.1:6801/13188] [v2:127.0.0.1:6802/13188,v1:127.0.0.1:6803/13188] exists,up d1de348d-5817-4ebc-b83f-818a2622d8ee 2020-02-08T18:16:57.635 INFO:tasks.workunit.client.0.smithi157.stdout:add osd1 98878f95-137d-4db4-851a-e033872d4f8e 2020-02-08T18:16:57.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:16:57.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:16:57.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 1 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=1 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:16:57.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/1 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/1' 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/1/journal' 2020-02-08T18:16:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:16:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:16:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:16:57.638 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:16:57.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:16:57.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/1 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=98878f95-137d-4db4-851a-e033872d4f8e 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd1 98878f95-137d-4db4-851a-e033872d4f8e' 2020-02-08T18:16:57.641 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:16:57.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQAZ+z5eOFhyJhAAzT7wTrI+rqXCkuyhl2IDzw== 2020-02-08T18:16:57.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQAZ+z5eOFhyJhAAzT7wTrI+rqXCkuyhl2IDzw=="}' 2020-02-08T18:16:57.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 98878f95-137d-4db4-851a-e033872d4f8e -i td/osd-recovery-scrub/1/new.json 2020-02-08T18:16:57.973 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:16:57.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/1/new.json 2020-02-08T18:16:57.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 1 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/1 --osd-journal=td/osd-recovery-scrub/1/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAZ+z5eOFhyJhAAzT7wTrI+rqXCkuyhl2IDzw== --osd-uuid 98878f95-137d-4db4-851a-e033872d4f8e 2020-02-08T18:16:58.004 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.001+0000 7f600022dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:58.014 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.012+0000 7f600022dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:58.015 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.012+0000 7f600022dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:16:58.015 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.013+0000 7f600022dec0 -1 bluestore(td/osd-recovery-scrub/1/block) _read_bdev_label failed to open td/osd-recovery-scrub/1/block: (2) No such file or directory 2020-02-08T18:16:58.015 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.013+0000 7f600022dec0 -1 bluestore(td/osd-recovery-scrub/1/block) _read_bdev_label failed to open td/osd-recovery-scrub/1/block: (2) No such file or directory 2020-02-08T18:16:58.016 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.013+0000 7f600022dec0 -1 bluestore(td/osd-recovery-scrub/1/block) _read_bdev_label failed to open td/osd-recovery-scrub/1/block: (2) No such file or directory 2020-02-08T18:16:58.081 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:16:58.079+0000 7f600022dec0 -1 bluestore(td/osd-recovery-scrub/1) _read_fsid unparsable uuid 2020-02-08T18:17:01.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/1/keyring 2020-02-08T18:17:01.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:01.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd1 key to auth repository 2020-02-08T18:17:01.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:01.143 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd1 key to auth repository 2020-02-08T18:17:01.458 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.1 2020-02-08T18:17:01.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.1 2020-02-08T18:17:01.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:01.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:01.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:01.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 1 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/1 --osd-journal=td/osd-recovery-scrub/1/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:01.464 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:01.461+0000 7f9b3734fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:01.465 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:01.462+0000 7f9b3734fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:01.466 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:01.464+0000 7f9b3734fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:01.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 1 2020-02-08T18:17:01.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:01.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=1 2020-02-08T18:17:01.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:01.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:01.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:01.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:01.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:01.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:17:01.692 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:01.982 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:01.979+0000 7f9b3734fec0 -1 Falling back to public interface 2020-02-08T18:17:02.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:02.729 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:02.726+0000 7f9b3734fec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-08T18:17:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:03.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:03.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:03.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:03.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:17:03.034 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:03.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:04.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:04.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:04.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:04.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:04.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:17:04.280 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:04.534 INFO:tasks.workunit.client.0.smithi157.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/13610,v1:127.0.0.1:6811/13610] [v2:127.0.0.1:6812/13610,v1:127.0.0.1:6813/13610] exists,up 98878f95-137d-4db4-851a-e033872d4f8e 2020-02-08T18:17:04.535 INFO:tasks.workunit.client.0.smithi157.stdout:add osd2 84c3b212-a53d-4a8c-8377-3beb641f0229 2020-02-08T18:17:04.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:04.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:04.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:17:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 2 2020-02-08T18:17:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:17:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:17:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=2 2020-02-08T18:17:04.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/2 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/2' 2020-02-08T18:17:04.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/2/journal' 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:17:04.539 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:17:04.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:17:04.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:17:04.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/2 2020-02-08T18:17:04.542 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:17:04.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=84c3b212-a53d-4a8c-8377-3beb641f0229 2020-02-08T18:17:04.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd2 84c3b212-a53d-4a8c-8377-3beb641f0229' 2020-02-08T18:17:04.542 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:17:04.543 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQAg+z5eeXj8HxAA0gqq+GluihE3botXE6/NVQ== 2020-02-08T18:17:04.543 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQAg+z5eeXj8HxAA0gqq+GluihE3botXE6/NVQ=="}' 2020-02-08T18:17:04.543 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 84c3b212-a53d-4a8c-8377-3beb641f0229 -i td/osd-recovery-scrub/2/new.json 2020-02-08T18:17:04.836 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:04.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/2/new.json 2020-02-08T18:17:04.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 2 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/2 --osd-journal=td/osd-recovery-scrub/2/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAg+z5eeXj8HxAA0gqq+GluihE3botXE6/NVQ== --osd-uuid 84c3b212-a53d-4a8c-8377-3beb641f0229 2020-02-08T18:17:04.867 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.865+0000 7f3c5a1c7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:04.869 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.867+0000 7f3c5a1c7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:04.871 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.868+0000 7f3c5a1c7ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:04.871 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.869+0000 7f3c5a1c7ec0 -1 bluestore(td/osd-recovery-scrub/2/block) _read_bdev_label failed to open td/osd-recovery-scrub/2/block: (2) No such file or directory 2020-02-08T18:17:04.871 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.869+0000 7f3c5a1c7ec0 -1 bluestore(td/osd-recovery-scrub/2/block) _read_bdev_label failed to open td/osd-recovery-scrub/2/block: (2) No such file or directory 2020-02-08T18:17:04.872 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.869+0000 7f3c5a1c7ec0 -1 bluestore(td/osd-recovery-scrub/2/block) _read_bdev_label failed to open td/osd-recovery-scrub/2/block: (2) No such file or directory 2020-02-08T18:17:04.952 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:04.951+0000 7f3c5a1c7ec0 -1 bluestore(td/osd-recovery-scrub/2) _read_fsid unparsable uuid 2020-02-08T18:17:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/2/keyring 2020-02-08T18:17:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd2 key to auth repository 2020-02-08T18:17:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:08.177 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd2 key to auth repository 2020-02-08T18:17:08.484 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.2 2020-02-08T18:17:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.2 2020-02-08T18:17:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:08.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:08.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 2 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/2 --osd-journal=td/osd-recovery-scrub/2/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:08.494 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:08.492+0000 7fc961003ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:08.495 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:08.494+0000 7fc961003ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:08.497 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:08.495+0000 7fc961003ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:08.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 2 2020-02-08T18:17:08.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:08.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=2 2020-02-08T18:17:08.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:08.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:08.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:08.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:08.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:08.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:17:08.715 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:08.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:09.012 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:09.010+0000 7fc961003ec0 -1 Falling back to public interface 2020-02-08T18:17:09.776 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:09.775+0000 7fc961003ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-02-08T18:17:09.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:09.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:09.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:09.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:09.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:17:09.954 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:10.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:11.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:11.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:11.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:11.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:11.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:17:11.209 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:11.454 INFO:tasks.workunit.client.0.smithi157.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/13988,v1:127.0.0.1:6819/13988] [v2:127.0.0.1:6820/13988,v1:127.0.0.1:6821/13988] exists,up 84c3b212-a53d-4a8c-8377-3beb641f0229 2020-02-08T18:17:11.454 INFO:tasks.workunit.client.0.smithi157.stdout:add osd3 b56a534e-235e-46ce-964c-0acf36be2afa 2020-02-08T18:17:11.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:11.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:11.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:11.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:17:11.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 3 2020-02-08T18:17:11.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:17:11.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:17:11.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=3 2020-02-08T18:17:11.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:17:11.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/3 2020-02-08T18:17:11.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:17:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:17:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:17:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:17:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/3' 2020-02-08T18:17:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/3/journal' 2020-02-08T18:17:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:17:11.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:17:11.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:17:11.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:17:11.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:11.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:17:11.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:17:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:17:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/3 2020-02-08T18:17:11.461 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:17:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=b56a534e-235e-46ce-964c-0acf36be2afa 2020-02-08T18:17:11.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd3 b56a534e-235e-46ce-964c-0acf36be2afa' 2020-02-08T18:17:11.462 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:17:11.467 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQAn+z5emi2sGxAAiEt1O0fMSDaBhmteOjKQcQ== 2020-02-08T18:17:11.468 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQAn+z5emi2sGxAAiEt1O0fMSDaBhmteOjKQcQ=="}' 2020-02-08T18:17:11.468 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new b56a534e-235e-46ce-964c-0acf36be2afa -i td/osd-recovery-scrub/3/new.json 2020-02-08T18:17:11.835 INFO:tasks.workunit.client.0.smithi157.stdout:3 2020-02-08T18:17:11.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/3/new.json 2020-02-08T18:17:11.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 3 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/3 --osd-journal=td/osd-recovery-scrub/3/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAn+z5emi2sGxAAiEt1O0fMSDaBhmteOjKQcQ== --osd-uuid b56a534e-235e-46ce-964c-0acf36be2afa 2020-02-08T18:17:11.867 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.865+0000 7f6c05d3aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:11.868 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.867+0000 7f6c05d3aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:11.870 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.867+0000 7f6c05d3aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:11.870 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.868+0000 7f6c05d3aec0 -1 bluestore(td/osd-recovery-scrub/3/block) _read_bdev_label failed to open td/osd-recovery-scrub/3/block: (2) No such file or directory 2020-02-08T18:17:11.870 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.868+0000 7f6c05d3aec0 -1 bluestore(td/osd-recovery-scrub/3/block) _read_bdev_label failed to open td/osd-recovery-scrub/3/block: (2) No such file or directory 2020-02-08T18:17:11.870 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.868+0000 7f6c05d3aec0 -1 bluestore(td/osd-recovery-scrub/3/block) _read_bdev_label failed to open td/osd-recovery-scrub/3/block: (2) No such file or directory 2020-02-08T18:17:11.959 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:11.957+0000 7f6c05d3aec0 -1 bluestore(td/osd-recovery-scrub/3) _read_fsid unparsable uuid 2020-02-08T18:17:14.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/3/keyring 2020-02-08T18:17:14.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:14.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd3 key to auth repository 2020-02-08T18:17:14.919 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:14.919 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd3 key to auth repository 2020-02-08T18:17:15.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.3 2020-02-08T18:17:15.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 3 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/3 --osd-journal=td/osd-recovery-scrub/3/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:15.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:15.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:15.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:15.223 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.3 2020-02-08T18:17:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:15.236+0000 7fc8deae8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:15.238+0000 7fc8deae8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:15.241 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:15.240+0000 7fc8deae8ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:15.464 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 3 2020-02-08T18:17:15.464 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:15.464 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=3 2020-02-08T18:17:15.465 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:15.465 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:15.465 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:15.465 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:15.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:15.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.3 up' 2020-02-08T18:17:15.466 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:15.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:15.757 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:15.755+0000 7fc8deae8ec0 -1 Falling back to public interface 2020-02-08T18:17:16.499 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:16.497+0000 7fc8deae8ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-02-08T18:17:16.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:16.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:16.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:16.699 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:16.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:16.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.3 up' 2020-02-08T18:17:16.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:17.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:17.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:17.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:17.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.3 up' 2020-02-08T18:17:17.951 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:18.207 INFO:tasks.workunit.client.0.smithi157.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/14365,v1:127.0.0.1:6827/14365] [v2:127.0.0.1:6828/14365,v1:127.0.0.1:6829/14365] exists,up b56a534e-235e-46ce-964c-0acf36be2afa 2020-02-08T18:17:18.207 INFO:tasks.workunit.client.0.smithi157.stdout:add osd4 05678e9b-c1ca-4953-9cab-596aa2600141 2020-02-08T18:17:18.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:18.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:18.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 4 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=4 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/4 2020-02-08T18:17:18.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/4' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/4/journal' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:17:18.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:17:18.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:17:18.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/4 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=05678e9b-c1ca-4953-9cab-596aa2600141 2020-02-08T18:17:18.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd4 05678e9b-c1ca-4953-9cab-596aa2600141' 2020-02-08T18:17:18.213 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:17:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQAu+z5eaG6xDBAANbQAA5C4Nff/9LwuXYzxag== 2020-02-08T18:17:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQAu+z5eaG6xDBAANbQAA5C4Nff/9LwuXYzxag=="}' 2020-02-08T18:17:18.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 05678e9b-c1ca-4953-9cab-596aa2600141 -i td/osd-recovery-scrub/4/new.json 2020-02-08T18:17:18.546 INFO:tasks.workunit.client.0.smithi157.stdout:4 2020-02-08T18:17:18.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/4/new.json 2020-02-08T18:17:18.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 4 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/4 --osd-journal=td/osd-recovery-scrub/4/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAu+z5eaG6xDBAANbQAA5C4Nff/9LwuXYzxag== --osd-uuid 05678e9b-c1ca-4953-9cab-596aa2600141 2020-02-08T18:17:18.572 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.571+0000 7f546bd7bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:18.574 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.572+0000 7f546bd7bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.573+0000 7f546bd7bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.574+0000 7f546bd7bec0 -1 bluestore(td/osd-recovery-scrub/4/block) _read_bdev_label failed to open td/osd-recovery-scrub/4/block: (2) No such file or directory 2020-02-08T18:17:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.574+0000 7f546bd7bec0 -1 bluestore(td/osd-recovery-scrub/4/block) _read_bdev_label failed to open td/osd-recovery-scrub/4/block: (2) No such file or directory 2020-02-08T18:17:18.576 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.574+0000 7f546bd7bec0 -1 bluestore(td/osd-recovery-scrub/4/block) _read_bdev_label failed to open td/osd-recovery-scrub/4/block: (2) No such file or directory 2020-02-08T18:17:18.632 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:18.631+0000 7f546bd7bec0 -1 bluestore(td/osd-recovery-scrub/4) _read_fsid unparsable uuid 2020-02-08T18:17:21.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/4/keyring 2020-02-08T18:17:21.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:21.710 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd4 key to auth repository 2020-02-08T18:17:21.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd4 key to auth repository 2020-02-08T18:17:21.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:22.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.4 2020-02-08T18:17:22.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 4 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/4 --osd-journal=td/osd-recovery-scrub/4/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:22.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:22.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:22.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:22.010 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.4 2020-02-08T18:17:22.028 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:22.026+0000 7fd25c0b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:22.029 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:22.028+0000 7fd25c0b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:22.030+0000 7fd25c0b9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:22.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 4 2020-02-08T18:17:22.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:22.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=4 2020-02-08T18:17:22.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:22.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:22.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:22.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:22.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:22.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:17:22.250 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:22.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:22.558 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:22.550+0000 7fd25c0b9ec0 -1 Falling back to public interface 2020-02-08T18:17:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:23.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:23.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:23.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:23.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:17:23.506 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:23.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:24.669 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:24.667+0000 7fd25c0b9ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-02-08T18:17:24.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:24.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:24.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:24.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:24.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:17:24.915 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:25.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:26.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:26.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 3 2020-02-08T18:17:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:26.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:17:26.222 INFO:tasks.workunit.client.0.smithi157.stdout:3 2020-02-08T18:17:26.470 INFO:tasks.workunit.client.0.smithi157.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/14750,v1:127.0.0.1:6835/14750] [v2:127.0.0.1:6836/14750,v1:127.0.0.1:6837/14750] exists,up 05678e9b-c1ca-4953-9cab-596aa2600141 2020-02-08T18:17:26.470 INFO:tasks.workunit.client.0.smithi157.stdout:add osd5 a0ef38cd-1dbc-4510-a124-896e99daa54d 2020-02-08T18:17:26.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:26.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:26.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 5 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=5 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:17:26.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/5 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/5' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/5/journal' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:17:26.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:17:26.473 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:17:26.474 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:17:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:17:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:17:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:17:26.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/5 2020-02-08T18:17:26.476 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:17:26.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=a0ef38cd-1dbc-4510-a124-896e99daa54d 2020-02-08T18:17:26.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd5 a0ef38cd-1dbc-4510-a124-896e99daa54d' 2020-02-08T18:17:26.476 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:17:26.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQA2+z5eLyKtHBAA5Vs1pP9H5C5MknLrTGNyKw== 2020-02-08T18:17:26.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQA2+z5eLyKtHBAA5Vs1pP9H5C5MknLrTGNyKw=="}' 2020-02-08T18:17:26.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new a0ef38cd-1dbc-4510-a124-896e99daa54d -i td/osd-recovery-scrub/5/new.json 2020-02-08T18:17:26.831 INFO:tasks.workunit.client.0.smithi157.stdout:5 2020-02-08T18:17:26.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/5/new.json 2020-02-08T18:17:26.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 5 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/5 --osd-journal=td/osd-recovery-scrub/5/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA2+z5eLyKtHBAA5Vs1pP9H5C5MknLrTGNyKw== --osd-uuid a0ef38cd-1dbc-4510-a124-896e99daa54d 2020-02-08T18:17:26.862 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.860+0000 7f31c4554ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:26.885 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.880+0000 7f31c4554ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:26.886 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.884+0000 7f31c4554ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:26.886 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.885+0000 7f31c4554ec0 -1 bluestore(td/osd-recovery-scrub/5/block) _read_bdev_label failed to open td/osd-recovery-scrub/5/block: (2) No such file or directory 2020-02-08T18:17:26.886 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.885+0000 7f31c4554ec0 -1 bluestore(td/osd-recovery-scrub/5/block) _read_bdev_label failed to open td/osd-recovery-scrub/5/block: (2) No such file or directory 2020-02-08T18:17:26.887 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.885+0000 7f31c4554ec0 -1 bluestore(td/osd-recovery-scrub/5/block) _read_bdev_label failed to open td/osd-recovery-scrub/5/block: (2) No such file or directory 2020-02-08T18:17:26.981 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:26.980+0000 7f31c4554ec0 -1 bluestore(td/osd-recovery-scrub/5) _read_fsid unparsable uuid 2020-02-08T18:17:30.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/5/keyring 2020-02-08T18:17:30.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:30.042 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd5 key to auth repository 2020-02-08T18:17:30.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd5 key to auth repository 2020-02-08T18:17:30.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:30.344 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.5 2020-02-08T18:17:30.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.5 2020-02-08T18:17:30.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:30.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 5 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/5 --osd-journal=td/osd-recovery-scrub/5/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:30.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:30.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:30.362 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:30.361+0000 7feae9fddec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:30.364 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:30.362+0000 7feae9fddec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:30.365 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:30.364+0000 7feae9fddec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:30.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 5 2020-02-08T18:17:30.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:30.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=5 2020-02-08T18:17:30.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:30.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:30.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:30.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:30.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:30.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.5 up' 2020-02-08T18:17:30.585 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:30.834 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:30.889 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:30.887+0000 7feae9fddec0 -1 Falling back to public interface 2020-02-08T18:17:31.708 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:31.707+0000 7feae9fddec0 -1 osd.5 0 log_to_monitors {default=true} 2020-02-08T18:17:31.835 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:31.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:31.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:31.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:31.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.5 up' 2020-02-08T18:17:31.836 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:32.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:33.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:33.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:33.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:33.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:33.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.5 up' 2020-02-08T18:17:33.102 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:33.350 INFO:tasks.workunit.client.0.smithi157.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/15154,v1:127.0.0.1:6843/15154] [v2:127.0.0.1:6844/15154,v1:127.0.0.1:6845/15154] exists,up a0ef38cd-1dbc-4510-a124-896e99daa54d 2020-02-08T18:17:33.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:33.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 6 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=6 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:17:33.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/6 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/6' 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/6/journal' 2020-02-08T18:17:33.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:17:33.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:17:33.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:17:33.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:17:33.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:33.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:17:33.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:17:33.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/6 2020-02-08T18:17:33.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:17:33.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=014603fc-8110-45ca-b960-1a030dcb3a24 2020-02-08T18:17:33.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd6 014603fc-8110-45ca-b960-1a030dcb3a24' 2020-02-08T18:17:33.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:17:33.357 INFO:tasks.workunit.client.0.smithi157.stdout:add osd6 014603fc-8110-45ca-b960-1a030dcb3a24 2020-02-08T18:17:33.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQA9+z5eYLCbFRAAn8Ole+rhDb7wuO8hazWmdA== 2020-02-08T18:17:33.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQA9+z5eYLCbFRAAn8Ole+rhDb7wuO8hazWmdA=="}' 2020-02-08T18:17:33.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 014603fc-8110-45ca-b960-1a030dcb3a24 -i td/osd-recovery-scrub/6/new.json 2020-02-08T18:17:33.711 INFO:tasks.workunit.client.0.smithi157.stdout:6 2020-02-08T18:17:33.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/6/new.json 2020-02-08T18:17:33.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 6 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/6 --osd-journal=td/osd-recovery-scrub/6/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA9+z5eYLCbFRAAn8Ole+rhDb7wuO8hazWmdA== --osd-uuid 014603fc-8110-45ca-b960-1a030dcb3a24 2020-02-08T18:17:33.742 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.740+0000 7f7242f29ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:33.743 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.742+0000 7f7242f29ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:33.745 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.744+0000 7f7242f29ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:33.746 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.744+0000 7f7242f29ec0 -1 bluestore(td/osd-recovery-scrub/6/block) _read_bdev_label failed to open td/osd-recovery-scrub/6/block: (2) No such file or directory 2020-02-08T18:17:33.746 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.744+0000 7f7242f29ec0 -1 bluestore(td/osd-recovery-scrub/6/block) _read_bdev_label failed to open td/osd-recovery-scrub/6/block: (2) No such file or directory 2020-02-08T18:17:33.746 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.744+0000 7f7242f29ec0 -1 bluestore(td/osd-recovery-scrub/6/block) _read_bdev_label failed to open td/osd-recovery-scrub/6/block: (2) No such file or directory 2020-02-08T18:17:33.814 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:33.811+0000 7f7242f29ec0 -1 bluestore(td/osd-recovery-scrub/6) _read_fsid unparsable uuid 2020-02-08T18:17:36.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/6/keyring 2020-02-08T18:17:36.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:36.786 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd6 key to auth repository 2020-02-08T18:17:36.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd6 key to auth repository 2020-02-08T18:17:36.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:37.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.6 2020-02-08T18:17:37.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:37.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 6 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/6 --osd-journal=td/osd-recovery-scrub/6/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:37.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:37.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:37.093 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.6 2020-02-08T18:17:37.109 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:37.107+0000 7f58a0ed9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:37.111 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:37.108+0000 7f58a0ed9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:37.113 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:37.111+0000 7f58a0ed9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:37.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 6 2020-02-08T18:17:37.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:37.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=6 2020-02-08T18:17:37.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:37.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:37.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:37.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:37.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:37.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.6 up' 2020-02-08T18:17:37.336 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:37.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:37.636 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:37.634+0000 7f58a0ed9ec0 -1 Falling back to public interface 2020-02-08T18:17:38.376 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:38.373+0000 7f58a0ed9ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-02-08T18:17:38.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:38.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:38.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:38.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:38.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.6 up' 2020-02-08T18:17:38.573 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:38.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.6 up' 2020-02-08T18:17:39.883 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:40.132 INFO:tasks.workunit.client.0.smithi157.stdout:osd.6 up in weight 1 up_from 35 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/15531,v1:127.0.0.1:6851/15531] [v2:127.0.0.1:6852/15531,v1:127.0.0.1:6853/15531] exists,up 014603fc-8110-45ca-b960-1a030dcb3a24 2020-02-08T18:17:40.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:40.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:40.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:40.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:47: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub: run_osd td/osd-recovery-scrub 7 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-recovery-scrub 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=7 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-recovery-scrub/7 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 ' 2020-02-08T18:17:40.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/7' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/7/journal' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2020-02-08T18:17:40.135 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:17:40.136 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:17:40.136 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:17:40.136 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:17:40.136 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:17:40.136 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:17:40.136 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:40.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:17:40.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:40.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:17:40.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:17:40.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-recovery-scrub/7 2020-02-08T18:17:40.139 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:17:40.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=594bbcc0-297f-46ee-991c-1ca2e78307b6 2020-02-08T18:17:40.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd7 594bbcc0-297f-46ee-991c-1ca2e78307b6' 2020-02-08T18:17:40.140 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:17:40.140 INFO:tasks.workunit.client.0.smithi157.stdout:add osd7 594bbcc0-297f-46ee-991c-1ca2e78307b6 2020-02-08T18:17:40.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQBE+z5eG2+eCBAAuT0YOIiyqYvQlJ1WwsLKYg== 2020-02-08T18:17:40.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQBE+z5eG2+eCBAAuT0YOIiyqYvQlJ1WwsLKYg=="}' 2020-02-08T18:17:40.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 594bbcc0-297f-46ee-991c-1ca2e78307b6 -i td/osd-recovery-scrub/7/new.json 2020-02-08T18:17:40.474 INFO:tasks.workunit.client.0.smithi157.stdout:7 2020-02-08T18:17:40.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-recovery-scrub/7/new.json 2020-02-08T18:17:40.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 7 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/7 --osd-journal=td/osd-recovery-scrub/7/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBE+z5eG2+eCBAAuT0YOIiyqYvQlJ1WwsLKYg== --osd-uuid 594bbcc0-297f-46ee-991c-1ca2e78307b6 2020-02-08T18:17:40.506 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.503+0000 7f91f24f5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:40.507 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.505+0000 7f91f24f5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:40.509 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.506+0000 7f91f24f5ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:40.509 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.507+0000 7f91f24f5ec0 -1 bluestore(td/osd-recovery-scrub/7/block) _read_bdev_label failed to open td/osd-recovery-scrub/7/block: (2) No such file or directory 2020-02-08T18:17:40.509 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.507+0000 7f91f24f5ec0 -1 bluestore(td/osd-recovery-scrub/7/block) _read_bdev_label failed to open td/osd-recovery-scrub/7/block: (2) No such file or directory 2020-02-08T18:17:40.509 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.507+0000 7f91f24f5ec0 -1 bluestore(td/osd-recovery-scrub/7/block) _read_bdev_label failed to open td/osd-recovery-scrub/7/block: (2) No such file or directory 2020-02-08T18:17:40.582 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:40.580+0000 7f91f24f5ec0 -1 bluestore(td/osd-recovery-scrub/7) _read_fsid unparsable uuid 2020-02-08T18:17:43.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-recovery-scrub/7/keyring 2020-02-08T18:17:43.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:17:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd7 key to auth repository 2020-02-08T18:17:43.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-recovery-scrub/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:17:43.812 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd7 key to auth repository 2020-02-08T18:17:44.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.7 2020-02-08T18:17:44.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 7 --fsid=3e9d5c8a-7b73-48bf-a706-95540704ceae --auth-supported=none --mon-host=127.0.0.1:7124 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/7 --osd-journal=td/osd-recovery-scrub/7/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.12840/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:17:44.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:17:44.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:17:44.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:17:44.123 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.7 2020-02-08T18:17:44.141 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:44.138+0000 7f1722dcbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:44.143 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:44.140+0000 7f1722dcbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:44.145 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:44.142+0000 7f1722dcbec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:17:44.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 7 2020-02-08T18:17:44.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:17:44.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=7 2020-02-08T18:17:44.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:17:44.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:17:44.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:44.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:17:44.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:44.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.7 up' 2020-02-08T18:17:44.364 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:17:44.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:44.660 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:44.657+0000 7f1722dcbec0 -1 Falling back to public interface 2020-02-08T18:17:45.417 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:17:45.415+0000 7f1722dcbec0 -1 osd.7 0 log_to_monitors {default=true} 2020-02-08T18:17:45.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:45.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:45.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:17:45.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:45.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.7 up' 2020-02-08T18:17:45.603 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:17:45.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:17:46.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:17:46.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:17:46.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:17:46.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:17:46.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.7 up' 2020-02-08T18:17:46.905 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:17:47.148 INFO:tasks.workunit.client.0.smithi157.stdout:osd.7 up in weight 1 up_from 40 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/15908,v1:127.0.0.1:6859/15908] [v2:127.0.0.1:6860/15908,v1:127.0.0.1:6861/15908] exists,up 594bbcc0-297f-46ee-991c-1ca2e78307b6 2020-02-08T18:17:47.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:17:47.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:17:47.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:17:47.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:53: TEST_recovery_scrub: create_pool test 32 32 2020-02-08T18:17:47.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:539: create_pool: ceph osd pool create test 32 32 2020-02-08T18:17:47.523 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'test' created 2020-02-08T18:17:47.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: sleep 1 2020-02-08T18:17:48.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:54: TEST_recovery_scrub: wait_for_clean 2020-02-08T18:17:48.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:17:48.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:17:48.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:17:48.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:17:48.534 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:17:48.535 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:17:48.536 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:17:48.536 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:17:48.536 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:17:48.536 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:17:48.625 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:17:48.625 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:17:48.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:17:48.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:17:48.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:17:48.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:17:48.911 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:17:48.911 INFO:tasks.workunit.client.0.smithi157.stderr:2 2020-02-08T18:17:48.911 INFO:tasks.workunit.client.0.smithi157.stderr:3 2020-02-08T18:17:48.912 INFO:tasks.workunit.client.0.smithi157.stderr:4 2020-02-08T18:17:48.912 INFO:tasks.workunit.client.0.smithi157.stderr:5 2020-02-08T18:17:48.912 INFO:tasks.workunit.client.0.smithi157.stderr:6 2020-02-08T18:17:48.912 INFO:tasks.workunit.client.0.smithi157.stderr:7' 2020-02-08T18:17:48.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:17:48.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:48.913 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:17:49.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=21474836492 2020-02-08T18:17:49.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492' 2020-02-08T18:17:49.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.090 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:17:49.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672972 2020-02-08T18:17:49.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972' 2020-02-08T18:17:49.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:17:49.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509450 2020-02-08T18:17:49.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-64424509450' 2020-02-08T18:17:49.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.324 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-02-08T18:17:49.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=85899345928 2020-02-08T18:17:49.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-64424509450 3-85899345928' 2020-02-08T18:17:49.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-02-08T18:17:49.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=107374182406 2020-02-08T18:17:49.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-64424509450 3-85899345928 4-107374182406' 2020-02-08T18:17:49.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.557 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-02-08T18:17:49.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=128849018885 2020-02-08T18:17:49.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-64424509450 3-85899345928 4-107374182406 5-128849018885' 2020-02-08T18:17:49.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.666 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2020-02-08T18:17:49.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=150323855364 2020-02-08T18:17:49.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-64424509450 3-85899345928 4-107374182406 5-128849018885 6-150323855364' 2020-02-08T18:17:49.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:17:49.776 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2020-02-08T18:17:49.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=171798691842 2020-02-08T18:17:49.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836492 1-42949672972 2-64424509450 3-85899345928 4-107374182406 5-128849018885 6-150323855364 7-171798691842' 2020-02-08T18:17:49.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:49.885 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-21474836492 2020-02-08T18:17:49.885 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:49.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:17:49.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-21474836492 2020-02-08T18:17:49.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:49.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=21474836492 2020-02-08T18:17:49.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2020-02-08T18:17:49.889 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:17:49.889 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.0 seq 21474836492 2020-02-08T18:17:50.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836492 -lt 21474836492 2020-02-08T18:17:50.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:50.126 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672972 2020-02-08T18:17:50.126 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:50.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:17:50.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672972 2020-02-08T18:17:50.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:50.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672972 2020-02-08T18:17:50.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2020-02-08T18:17:50.129 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.1 seq 42949672972 2020-02-08T18:17:50.130 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:17:50.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672972 -lt 42949672972 2020-02-08T18:17:50.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:50.367 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509450 2020-02-08T18:17:50.368 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:50.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:17:50.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509450 2020-02-08T18:17:50.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:50.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509450 2020-02-08T18:17:50.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2020-02-08T18:17:50.371 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.2 seq 64424509450 2020-02-08T18:17:50.371 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:17:50.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509450 -lt 64424509450 2020-02-08T18:17:50.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:50.612 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 3-85899345928 2020-02-08T18:17:50.612 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:50.613 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=3 2020-02-08T18:17:50.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 3-85899345928 2020-02-08T18:17:50.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:50.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=85899345928 2020-02-08T18:17:50.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.3 seq 85899345928' 2020-02-08T18:17:50.615 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.3 seq 85899345928 2020-02-08T18:17:50.616 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 3 2020-02-08T18:17:50.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 85899345928 -lt 85899345928 2020-02-08T18:17:50.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:50.855 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 4-107374182406 2020-02-08T18:17:50.856 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:50.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=4 2020-02-08T18:17:50.857 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 4-107374182406 2020-02-08T18:17:50.857 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:50.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=107374182406 2020-02-08T18:17:50.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2020-02-08T18:17:50.859 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.4 seq 107374182406 2020-02-08T18:17:50.859 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 4 2020-02-08T18:17:51.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 107374182405 -lt 107374182406 2020-02-08T18:17:51.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:17:52.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:17:52.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 4 2020-02-08T18:17:52.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 107374182407 -lt 107374182406 2020-02-08T18:17:52.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:52.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 5-128849018885 2020-02-08T18:17:52.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:52.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=5 2020-02-08T18:17:52.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 5-128849018885 2020-02-08T18:17:52.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:52.354 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.5 seq 128849018885 2020-02-08T18:17:52.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=128849018885 2020-02-08T18:17:52.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.5 seq 128849018885' 2020-02-08T18:17:52.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 5 2020-02-08T18:17:52.593 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 128849018885 -lt 128849018885 2020-02-08T18:17:52.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:52.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 6-150323855364 2020-02-08T18:17:52.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:52.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=6 2020-02-08T18:17:52.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 6-150323855364 2020-02-08T18:17:52.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:52.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=150323855364 2020-02-08T18:17:52.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.6 seq 150323855364' 2020-02-08T18:17:52.597 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.6 seq 150323855364 2020-02-08T18:17:52.597 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 6 2020-02-08T18:17:52.834 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 150323855364 -lt 150323855364 2020-02-08T18:17:52.835 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:17:52.835 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 7-171798691842 2020-02-08T18:17:52.836 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:17:52.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=7 2020-02-08T18:17:52.837 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 7-171798691842 2020-02-08T18:17:52.838 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:17:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=171798691842 2020-02-08T18:17:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.7 seq 171798691842' 2020-02-08T18:17:52.839 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 7 2020-02-08T18:17:52.840 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.7 seq 171798691842 2020-02-08T18:17:53.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 171798691842 -lt 171798691842 2020-02-08T18:17:53.078 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:17:53.078 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:17:53.078 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:17:53.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 32 == 0 2020-02-08T18:17:53.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:17:53.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:17:53.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:17:53.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:17:53.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:17:53.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:17:53.363 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:17:53.604 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=32 2020-02-08T18:17:53.605 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:17:53.605 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:17:53.606 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:17:53.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 32 = 32 2020-02-08T18:17:53.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:17:53.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:17:53.890 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub: ceph osd dump 2020-02-08T18:17:53.890 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub: grep '^pool.*['\'']test['\'']' 2020-02-08T18:17:53.891 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub: awk '{ print $2 }' 2020-02-08T18:17:54.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub: poolid=1 2020-02-08T18:17:54.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub: dd if=/dev/urandom of=testdata.12840 bs=1M count=50 2020-02-08T18:17:54.356 INFO:tasks.workunit.client.0.smithi157.stderr:50+0 records in 2020-02-08T18:17:54.356 INFO:tasks.workunit.client.0.smithi157.stderr:50+0 records out 2020-02-08T18:17:54.356 INFO:tasks.workunit.client.0.smithi157.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.227457 s, 231 MB/s 2020-02-08T18:17:54.357 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:58: TEST_recovery_scrub: seq 1 4 2020-02-08T18:17:54.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:58: TEST_recovery_scrub: for i in $(seq 1 $OBJECTS) 2020-02-08T18:17:54.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:60: TEST_recovery_scrub: rados -p test put obj1 testdata.12840 2020-02-08T18:17:55.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:58: TEST_recovery_scrub: for i in $(seq 1 $OBJECTS) 2020-02-08T18:17:55.857 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:60: TEST_recovery_scrub: rados -p test put obj2 testdata.12840 2020-02-08T18:17:57.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:58: TEST_recovery_scrub: for i in $(seq 1 $OBJECTS) 2020-02-08T18:17:57.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:60: TEST_recovery_scrub: rados -p test put obj3 testdata.12840 2020-02-08T18:17:58.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:58: TEST_recovery_scrub: for i in $(seq 1 $OBJECTS) 2020-02-08T18:17:58.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:60: TEST_recovery_scrub: rados -p test put obj4 testdata.12840 2020-02-08T18:17:59.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:62: TEST_recovery_scrub: rm -f testdata.12840 2020-02-08T18:17:59.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:64: TEST_recovery_scrub: ceph osd pool set test size 4 2020-02-08T18:18:00.080 INFO:tasks.workunit.client.0.smithi157.stderr:set pool 1 size to 4 2020-02-08T18:18:00.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:66: TEST_recovery_scrub: pids= 2020-02-08T18:18:00.090 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: expr 32 - 1 2020-02-08T18:18:00.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: seq 0 31 2020-02-08T18:18:00.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 0 2020-02-08T18:18:00.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.0 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17017"' 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17017' 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.0 2020-02-08T18:18:00.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 1 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17024"' 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17024' 2020-02-08T18:18:00.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1 2020-02-08T18:18:00.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 2 2020-02-08T18:18:00.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.2 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17031"' 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17031' 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.2 2020-02-08T18:18:00.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 3 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.3 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17038"' 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17038' 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.3 2020-02-08T18:18:00.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.103 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 4 2020-02-08T18:18:00.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.4 2020-02-08T18:18:00.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17045"' 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17045' 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.4 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 5 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.5 2020-02-08T18:18:00.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17052"' 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17052' 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.5 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 6 2020-02-08T18:18:00.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.6 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17059"' 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17059' 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.6 2020-02-08T18:18:00.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 7 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.7 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17066"' 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17066' 2020-02-08T18:18:00.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.7 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 8 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.8 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17073"' 2020-02-08T18:18:00.111 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17073' 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.8 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 9 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.9 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17078"' 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17078' 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.9 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 10 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.a 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17085"' 2020-02-08T18:18:00.114 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17085' 2020-02-08T18:18:00.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.a 2020-02-08T18:18:00.115 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 11 2020-02-08T18:18:00.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.b 2020-02-08T18:18:00.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17094"' 2020-02-08T18:18:00.116 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17094' 2020-02-08T18:18:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.118 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 12 2020-02-08T18:18:00.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.c 2020-02-08T18:18:00.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17098"' 2020-02-08T18:18:00.120 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17098' 2020-02-08T18:18:00.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.c 2020-02-08T18:18:00.122 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 13 2020-02-08T18:18:00.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.d 2020-02-08T18:18:00.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17105"' 2020-02-08T18:18:00.123 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17105' 2020-02-08T18:18:00.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.d 2020-02-08T18:18:00.125 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 14 2020-02-08T18:18:00.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.e 2020-02-08T18:18:00.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17112"' 2020-02-08T18:18:00.127 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17112' 2020-02-08T18:18:00.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.127 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 15 2020-02-08T18:18:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.f 2020-02-08T18:18:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17114"' 2020-02-08T18:18:00.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17114' 2020-02-08T18:18:00.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.f 2020-02-08T18:18:00.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.e 2020-02-08T18:18:00.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.b 2020-02-08T18:18:00.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.134 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 16 2020-02-08T18:18:00.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.10 2020-02-08T18:18:00.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17127"' 2020-02-08T18:18:00.136 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17127' 2020-02-08T18:18:00.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.144 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.145 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 17 2020-02-08T18:18:00.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.11 2020-02-08T18:18:00.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.147 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.147 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17131"' 2020-02-08T18:18:00.147 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17131' 2020-02-08T18:18:00.147 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.147 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 18 2020-02-08T18:18:00.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.12 2020-02-08T18:18:00.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17133"' 2020-02-08T18:18:00.149 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17133' 2020-02-08T18:18:00.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.155 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 19 2020-02-08T18:18:00.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.13 2020-02-08T18:18:00.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17139"' 2020-02-08T18:18:00.163 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17139' 2020-02-08T18:18:00.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.10 2020-02-08T18:18:00.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.169 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.11 2020-02-08T18:18:00.175 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 20 2020-02-08T18:18:00.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.14 2020-02-08T18:18:00.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17145"' 2020-02-08T18:18:00.177 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17145' 2020-02-08T18:18:00.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.13 2020-02-08T18:18:00.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.186 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.12 2020-02-08T18:18:00.187 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 21 2020-02-08T18:18:00.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.15 2020-02-08T18:18:00.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.189 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17156"' 2020-02-08T18:18:00.189 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17156' 2020-02-08T18:18:00.189 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.189 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.193 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.14 2020-02-08T18:18:00.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 22 2020-02-08T18:18:00.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.16 2020-02-08T18:18:00.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17164"' 2020-02-08T18:18:00.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17164' 2020-02-08T18:18:00.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.15 2020-02-08T18:18:00.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.207 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 23 2020-02-08T18:18:00.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.17 2020-02-08T18:18:00.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17173"' 2020-02-08T18:18:00.209 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17173' 2020-02-08T18:18:00.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.216 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 24 2020-02-08T18:18:00.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.18 2020-02-08T18:18:00.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.17 2020-02-08T18:18:00.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17180"' 2020-02-08T18:18:00.219 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17180' 2020-02-08T18:18:00.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.16 2020-02-08T18:18:00.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.18 2020-02-08T18:18:00.228 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 25 2020-02-08T18:18:00.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.19 2020-02-08T18:18:00.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17192"' 2020-02-08T18:18:00.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17192' 2020-02-08T18:18:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.240 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 26 2020-02-08T18:18:00.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1a 2020-02-08T18:18:00.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17198"' 2020-02-08T18:18:00.241 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17198' 2020-02-08T18:18:00.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.242 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 27 2020-02-08T18:18:00.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1b 2020-02-08T18:18:00.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17202"' 2020-02-08T18:18:00.244 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17202' 2020-02-08T18:18:00.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.19 2020-02-08T18:18:00.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.245 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1b 2020-02-08T18:18:00.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.264 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 28 2020-02-08T18:18:00.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1c 2020-02-08T18:18:00.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17217"' 2020-02-08T18:18:00.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17217' 2020-02-08T18:18:00.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.279 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 29 2020-02-08T18:18:00.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1a 2020-02-08T18:18:00.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1d 2020-02-08T18:18:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17224"' 2020-02-08T18:18:00.288 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17224' 2020-02-08T18:18:00.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1c 2020-02-08T18:18:00.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.303 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 30 2020-02-08T18:18:00.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1e 2020-02-08T18:18:00.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17233"' 2020-02-08T18:18:00.305 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17233' 2020-02-08T18:18:00.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub: for pg in $(seq 0 $(expr $PGS - 1)) 2020-02-08T18:18:00.320 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: printf %x 31 2020-02-08T18:18:00.327 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:69: TEST_recovery_scrub: run_in_background pids pg_scrub 1.1f 2020-02-08T18:18:00.327 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1995: run_in_background: local pid_variable=pids 2020-02-08T18:18:00.327 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1996: run_in_background: shift 2020-02-08T18:18:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: eval 'pids+=" 17243"' 2020-02-08T18:18:00.328 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2000: run_in_background: pids+=' 17243' 2020-02-08T18:18:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:71: TEST_recovery_scrub: ceph pg dump pgs 2020-02-08T18:18:00.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1d 2020-02-08T18:18:00.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:00.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1e 2020-02-08T18:18:00.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: pg_scrub 1.1f 2020-02-08T18:18:00.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: sed 's/^/12840: /' 2020-02-08T18:18:02.566 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:18:02.566 INFO:tasks.workunit.client.0.smithi157.stdout:1.1f 1 0 0 0 0 52428800 0 0 13 13 active+clean 2020-02-08T18:17:48.540032+0000 49'13 49:25 [5] 5 [5] 5 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.566 INFO:tasks.workunit.client.0.smithi157.stdout:1.1e 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.094143+0000 0'0 48:13 [3] 3 [3] 3 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.1d 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.188620+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.1c 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:47.970679+0000 0'0 46:11 [0] 0 [0] 0 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.1b 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:47.970333+0000 0'0 46:11 [0] 0 [0] 0 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.1a 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.188351+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.19 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.094030+0000 0'0 48:13 [3] 3 [3] 3 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.18 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.343855+0000 0'0 48:12 [5] 5 [5] 5 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.567 INFO:tasks.workunit.client.0.smithi157.stdout:1.17 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:47.970125+0000 0'0 46:11 [0] 0 [0] 0 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.16 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.900348+0000 0'0 47:9 [6] 6 [6] 6 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.15 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.165177+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.14 0 0 0 0 0 0 0 0 0 0 activating 2020-02-08T18:18:00.672453+0000 0'0 51:17 [2,0,4,5] 2 [2,0,4,5] 2 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.13 0 0 0 0 0 0 0 0 0 0 peering 2020-02-08T18:18:00.296775+0000 0'0 50:14 [4,6,3,1] 4 [4,6,3,1] 4 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.12 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:47.970764+0000 0'0 46:11 [0] 0 [0] 0 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.11 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:47.851777+0000 0'0 46:11 [0] 0 [0] 0 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.568 INFO:tasks.workunit.client.0.smithi157.stdout:1.10 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.539470+0000 0'0 48:12 [5] 5 [5] 5 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.569 INFO:tasks.workunit.client.0.smithi157.stdout:1.5 0 0 0 0 0 0 0 0 0 0 peering 2020-02-08T18:18:00.294883+0000 0'0 50:14 [4,2,6,5] 4 [4,2,6,5] 4 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.569 INFO:tasks.workunit.client.0.smithi157.stdout:1.4 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.062234+0000 0'0 48:13 [3] 3 [3] 3 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.569 INFO:tasks.workunit.client.0.smithi157.stdout:1.3 0 0 0 0 0 0 0 0 0 0 peering 2020-02-08T18:18:00.296028+0000 0'0 50:14 [4,1,2,6] 4 [4,1,2,6] 4 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.569 INFO:tasks.workunit.client.0.smithi157.stdout:1.2 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:47.970200+0000 0'0 46:11 [0] 0 [0] 0 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.569 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.958534+0000 0'0 48:10 [7] 7 [7] 7 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.569 INFO:tasks.workunit.client.0.smithi157.stdout:1.1 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.539944+0000 0'0 48:12 [5] 5 [5] 5 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.570 INFO:tasks.workunit.client.0.smithi157.stdout:1.6 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.899987+0000 0'0 47:9 [6] 6 [6] 6 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.570 INFO:tasks.workunit.client.0.smithi157.stdout:1.7 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.899908+0000 0'0 47:9 [6] 6 [6] 6 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.570 INFO:tasks.workunit.client.0.smithi157.stdout:1.8 1 0 0 0 0 52428800 0 0 13 13 active+clean 2020-02-08T18:17:48.539471+0000 49'13 49:25 [5] 5 [5] 5 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.570 INFO:tasks.workunit.client.0.smithi157.stdout:1.9 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.188534+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.570 INFO:tasks.workunit.client.0.smithi157.stdout:1.a 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.187994+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.571 INFO:tasks.workunit.client.0.smithi157.stdout:1.b 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.188488+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.571 INFO:tasks.workunit.client.0.smithi157.stdout:1.c 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.093681+0000 0'0 48:13 [3] 3 [3] 3 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.571 INFO:tasks.workunit.client.0.smithi157.stdout:1.d 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.969422+0000 0'0 48:10 [7] 7 [7] 7 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.571 INFO:tasks.workunit.client.0.smithi157.stdout:1.e 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.188039+0000 0'0 48:12 [1] 1 [1] 1 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.571 INFO:tasks.workunit.client.0.smithi157.stdout:1.f 0 0 0 0 0 0 0 0 0 0 active+clean 2020-02-08T18:17:48.844287+0000 0'0 47:9 [6] 6 [6] 6 0'0 2020-02-08T18:17:47.439528+0000 0'0 2020-02-08T18:17:47.439528+0000 0 2020-02-08T18:18:02.572 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:18:02.572 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:18:02.593 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:18:02.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:72: TEST_recovery_scrub: wait_background pids 2020-02-08T18:18:02.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: wait_background: pids=' 17017 17024 17031 17038 17045 17052 17059 17066 17073 17078 17085 17094 17098 17105 17112 17114 17127 17131 17133 17139 17145 17156 17164 17173 17180 17192 17198 17202 17217 17224 17233 17243' 2020-02-08T18:18:02.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2033: wait_background: return_code=0 2020-02-08T18:18:02.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:02.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17017 2020-02-08T18:18:07.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.9 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.9 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.9 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.9 on osd.1 to scrub 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.9 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.9 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.552 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.553 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.554 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:07.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.6 2020-02-08T18:18:07.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.6 2020-02-08T18:18:07.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.6 2020-02-08T18:18:07.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2020-02-08T18:18:07.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.6 2020-02-08T18:18:07.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.6 on osd.6 to scrub 2020-02-08T18:18:07.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.6 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.6 2020-02-08T18:18:07.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:07.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:07.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.679 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2020-02-08T18:18:07.679 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.6 2020-02-08T18:18:07.680 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.680 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.680 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2020-02-08T18:18:07.680 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.681 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.681 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:07.681 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.681 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2020-02-08T18:18:07.681 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.6 2020-02-08T18:18:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2020-02-08T18:18:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.682 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:07.821 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.10 2020-02-08T18:18:07.821 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.10 2020-02-08T18:18:07.821 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.10 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.10 on osd.5 to scrub 2020-02-08T18:18:07.822 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.10 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.10 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:07.823 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:07.824 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.824 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.824 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:07.824 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.824 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.824 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.825 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:07.826 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.826 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1 2020-02-08T18:18:07.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1 2020-02-08T18:18:07.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:07.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:07.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1 2020-02-08T18:18:07.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1 on osd.5 to scrub 2020-02-08T18:18:07.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1 2020-02-08T18:18:07.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:07.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:07.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:07.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:07.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:07.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:07.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:07.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:07.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:07.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:07.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:07.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:07.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:07.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:07.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.012 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.3 2020-02-08T18:18:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.3 2020-02-08T18:18:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.3 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.3 on osd.4 to scrub 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.3 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.3 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.014 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:08.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.122 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.7 2020-02-08T18:18:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.7 2020-02-08T18:18:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:08.123 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.7 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.7 on osd.6 to scrub 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.7 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.7 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.124 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.125 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.126 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:08.127 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.127 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.127 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.172 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.c 2020-02-08T18:18:08.173 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.c 2020-02-08T18:18:08.173 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:08.173 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.c 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.c on osd.3 to scrub 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.c 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.174 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.c 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:08.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:08.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.0 2020-02-08T18:18:08.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.0 2020-02-08T18:18:08.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:08.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.0 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.0 on osd.7 to scrub 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.0 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.0 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:08.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.181 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.182 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:08.182 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.182 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.182 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.4 2020-02-08T18:18:08.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.4 2020-02-08T18:18:08.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.4 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.4 on osd.3 to scrub 2020-02-08T18:18:08.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.4 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.4 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:08.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.541 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.773 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.2 2020-02-08T18:18:08.773 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.2 2020-02-08T18:18:08.773 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:08.773 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.774 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.774 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:08.774 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.774 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.2 2020-02-08T18:18:08.775 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.2 on osd.0 to scrub 2020-02-08T18:18:08.775 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.2 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.775 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.2 2020-02-08T18:18:08.775 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.775 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.776 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.776 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.776 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:08.776 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:08.777 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.777 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.777 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:08.777 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.778 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.778 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.779 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.779 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:08.779 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:08.779 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:08.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.18 2020-02-08T18:18:08.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.18 2020-02-08T18:18:08.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:08.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:08.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.783 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.18 2020-02-08T18:18:08.783 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.18 on osd.5 to scrub 2020-02-08T18:18:08.783 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.18 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.783 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.18 2020-02-08T18:18:08.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:08.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:08.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:08.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.788 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.788 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.850 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.15 2020-02-08T18:18:08.850 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.15 2020-02-08T18:18:08.850 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.15 2020-02-08T18:18:08.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.15 on osd.1 to scrub 2020-02-08T18:18:08.852 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.15 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.852 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.15 2020-02-08T18:18:08.852 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.852 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.853 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:08.854 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.854 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.854 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.856 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.899 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.11 2020-02-08T18:18:08.900 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.11 2020-02-08T18:18:08.900 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:08.900 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.900 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.900 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.11 2020-02-08T18:18:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.11 on osd.0 to scrub 2020-02-08T18:18:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.11 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.11 2020-02-08T18:18:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.902 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:08.902 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:08.902 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.902 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:08.902 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:08.902 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:08.904 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:08.904 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:08.904 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:08.905 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:08.905 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:08.905 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:08.905 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.099 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1b 2020-02-08T18:18:09.099 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1b 2020-02-08T18:18:09.099 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:09.099 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.100 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:09.100 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.100 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.100 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1b 2020-02-08T18:18:09.101 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1b on osd.0 to scrub 2020-02-08T18:18:09.101 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1b 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.101 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1b 2020-02-08T18:18:09.101 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.101 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.102 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.102 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.102 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:09.102 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:09.103 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.103 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:09.103 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.103 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.103 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.104 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.104 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.104 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:09.104 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:09.105 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.105 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.106 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:09.109 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.109 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.111 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.12 2020-02-08T18:18:09.111 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.12 2020-02-08T18:18:09.112 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:09.112 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.112 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:09.113 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.113 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.113 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.12 2020-02-08T18:18:09.113 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.12 on osd.0 to scrub 2020-02-08T18:18:09.114 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.12 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.114 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.12 2020-02-08T18:18:09.114 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.114 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.114 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.115 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.115 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:09.115 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:09.115 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.116 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.116 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:09.116 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.117 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:09.118 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.118 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.118 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.167 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.19 2020-02-08T18:18:09.168 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.19 2020-02-08T18:18:09.168 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:09.168 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.19 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.19 on osd.3 to scrub 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.19 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.19 2020-02-08T18:18:09.169 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.170 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.172 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.172 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:09.172 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.172 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.226 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.13 2020-02-08T18:18:09.226 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.13 2020-02-08T18:18:09.226 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:09.226 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.13 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.13 on osd.4 to scrub 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.13 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.227 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.13 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:09.228 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:09.229 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:09.230 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.230 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.230 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:09.230 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.230 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.378 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.e 2020-02-08T18:18:09.378 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.e 2020-02-08T18:18:09.378 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:09.378 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.379 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.379 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:09.379 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.379 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.e 2020-02-08T18:18:09.380 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.e on osd.1 to scrub 2020-02-08T18:18:09.380 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.e 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.380 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.e 2020-02-08T18:18:09.380 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:09.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:09.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:09.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.394 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.17 2020-02-08T18:18:09.394 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.17 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.17 2020-02-08T18:18:09.395 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.17 on osd.0 to scrub 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.17 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.17 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.396 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:09.397 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:09.397 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.397 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:09.397 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.397 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.397 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:09.398 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.399 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.399 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1c 2020-02-08T18:18:09.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1c 2020-02-08T18:18:09.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:09.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:09.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1c 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1c on osd.0 to scrub 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1c 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1c 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:09.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1a 2020-02-08T18:18:09.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1a 2020-02-08T18:18:09.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:09.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1a 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1a on osd.1 to scrub 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1a 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1a 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:09.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.538 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.540 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.b 2020-02-08T18:18:09.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.b 2020-02-08T18:18:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.b 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.b on osd.1 to scrub 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.b 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.b 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:09.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:09.587 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.587 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.587 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.587 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.655 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1e 2020-02-08T18:18:09.655 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1e 2020-02-08T18:18:09.655 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:09.655 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1e 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1e on osd.3 to scrub 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1e 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.656 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1e 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.657 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:09.658 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:09.659 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.659 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:09.659 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.659 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.659 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.702 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.5 2020-02-08T18:18:09.702 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.5 2020-02-08T18:18:09.702 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:09.702 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.702 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.702 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.5 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.5 on osd.4 to scrub 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.5 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.5 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:09.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:09.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.a 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.a 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.a 2020-02-08T18:18:09.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.a on osd.1 to scrub 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.a 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.a 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:09.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.710 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:09.710 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:09.710 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.710 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:09.712 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.712 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.712 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.712 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.d 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.d 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:09.714 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.d 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.d on osd.7 to scrub 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.d 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.d 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.715 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.716 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:09.717 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.718 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.718 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.718 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.783 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.16 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.16 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.784 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.16 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.16 on osd.6 to scrub 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.16 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.16 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.785 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.786 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.787 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.788 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.793 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.f 2020-02-08T18:18:09.793 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.f 2020-02-08T18:18:09.793 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.f 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.f on osd.6 to scrub 2020-02-08T18:18:09.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.f 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.f 2020-02-08T18:18:09.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:09.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.798 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.8 2020-02-08T18:18:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.8 2020-02-08T18:18:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:09.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.8 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.8 on osd.5 to scrub 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.8 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.8 2020-02-08T18:18:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:09.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.814 INFO:tasks.workunit.client.0.smithi157.stderr:12840: 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1f 2020-02-08T18:18:09.814 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1f 2020-02-08T18:18:09.814 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:09.814 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.814 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1f 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1f on osd.5 to scrub 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1f 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1f 2020-02-08T18:18:09.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:09.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:09.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.844 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.1d 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.1d 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.845 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.1d 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.1d on osd.1 to scrub 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.1d 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.1d 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.846 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.847 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.848 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( 12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1785: pg_scrub: local pgid=1.14 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: get_last_scrub_stamp 1.14 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1786: pg_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: ceph pg scrub 1.14 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: instructing pg 1.14 on osd.2 to scrub 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: wait_for_scrub 1.14 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.14 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.886 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:09.887 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:09.888 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:13.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:13.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2020-02-08T18:18:13.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.6 2020-02-08T18:18:13.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:13.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2020-02-08T18:18:13.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:13.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:13.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:13.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:13.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:13.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2020-02-08T18:18:13.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.6 2020-02-08T18:18:13.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:13.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2020-02-08T18:18:13.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:13.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:13.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:13.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:13.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:13.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2020-02-08T18:18:13.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.6 2020-02-08T18:18:13.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:13.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:13.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2020-02-08T18:18:13.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:06.310427+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:13.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:13.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:14.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.015 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.016 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:14.017 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:14.018 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:14.019 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.216 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:14.216 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.216 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:14.216 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:14.216 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:14.217 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.218 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.219 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.220 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.220 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:14.220 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:14.220 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.619 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.620 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:14.620 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:14.620 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.620 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.621 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:14.621 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.621 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.621 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.621 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.622 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:14.622 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:14.622 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.622 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:14.622 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.623 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.623 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.623 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.623 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.624 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:14.624 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:14.624 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.624 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.624 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:14.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:14.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:14.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.671 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.671 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:14.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:14.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:14.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:14.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:14.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:14.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:14.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:14.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:14.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:14.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:14.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:14.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:14.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:14.871 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.872 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.873 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:14.873 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:14.873 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:14.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:14.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:14.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:14.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:14.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.990 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:14.990 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.991 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.992 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:14.993 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:14.994 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.146 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.146 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.146 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:15.146 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:15.146 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.147 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.147 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:15.147 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.147 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.147 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.148 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:15.149 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:15.150 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.191 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.191 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:15.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:15.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:15.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:15.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:15.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:15.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:15.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:15.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:15.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:15.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:15.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.235 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:15.236 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.237 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.237 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:15.237 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.237 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:15.238 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.239 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.240 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.240 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.240 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:15.240 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:15.241 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.241 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.241 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:15.241 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.241 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.242 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.242 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.242 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:15.242 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:15.243 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.261 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:15.261 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:15.261 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.262 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.262 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:15.262 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.262 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.263 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.263 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.263 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:15.263 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:15.263 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.264 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.265 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.265 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.265 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:15.265 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:15.266 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.266 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.266 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:15.266 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.267 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.267 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.267 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.267 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:15.267 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:15.268 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.280 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.280 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:15.280 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:15.281 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.281 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:15.281 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.282 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:15.283 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:15.283 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.283 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:15.283 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.284 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.284 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.284 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.284 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.285 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:15.285 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:15.285 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.285 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.286 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:15.286 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.286 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.286 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.286 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.287 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:15.287 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:15.287 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.307 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:15.307 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.309 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:15.309 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:15.309 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.309 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.310 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:15.310 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.310 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.310 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.310 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.311 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:15.311 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:15.311 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.311 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:15.312 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.312 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.312 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.312 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.313 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.313 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:15.313 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:15.313 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.313 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.314 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:15.314 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.314 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.314 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.315 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.315 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:15.315 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:15.315 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.362 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.365 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:15.365 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.365 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.365 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.365 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.365 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:15.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:15.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:15.373 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:15.374 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.383 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.383 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.384 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:15.385 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.386 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.386 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.386 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.386 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:15.386 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:15.386 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.387 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:15.388 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:15.388 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.405 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.405 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.405 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:15.405 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:15.405 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.406 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:15.407 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:15.407 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.407 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.407 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:15.407 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.407 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.408 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.409 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:15.410 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:15.410 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.451 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.451 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.451 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:15.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:15.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:15.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:15.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:15.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:15.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:15.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:15.457 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:15.457 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.493 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:15.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:15.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:15.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:15.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:15.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:15.496 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.497 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:15.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:15.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.498 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:15.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.499 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:15.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:15.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.532 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.532 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:15.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:15.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:15.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.533 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.534 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:15.535 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.536 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:15.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:15.537 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.545 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.545 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:15.545 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:15.545 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.545 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.545 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:15.546 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:15.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:15.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:15.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:15.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:15.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.572 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:15.572 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.573 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:15.573 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:15.573 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.573 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.573 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:15.573 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.574 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.575 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:15.575 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.575 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.575 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.575 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.575 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.576 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:15.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:15.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.582 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:15.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:15.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:15.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:15.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:15.586 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.590 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:15.590 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.590 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:15.590 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:15.591 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.591 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.591 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:15.592 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.592 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.592 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.592 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.592 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:15.593 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:15.593 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.593 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.593 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:15.594 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.596 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:15.596 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:15.598 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.642 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:15.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:15.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:15.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.646 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:15.646 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:15.646 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.646 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.646 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:15.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:15.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:15.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:15.660 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.660 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.661 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.661 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.661 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.661 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:15.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:15.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:15.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:15.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:15.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:15.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:15.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.667 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:15.667 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.667 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.667 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.668 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:15.669 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.669 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.669 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.669 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.669 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:15.670 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:15.670 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.671 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephte/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.671 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:15.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:15.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:15.672 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.673 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:15.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:15.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:15.674 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.675 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:15.676 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:15.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.677 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:15.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.678 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:15.679 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:15.679 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.726 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:15.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:15.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:15.730 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.730 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.730 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:15.731 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.798 INFO:tasks.workunit.client.0.smithi157.stderr:12i++ )) 2020-02-08T18:18:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.799 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.800 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:15.801 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.802 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:15.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:15.804 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.814 INFO:tasks.workunit.client.0.smithi157.stderr:12/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.814 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:15.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:15.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.815 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:15.817 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.818 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.819 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:15.819 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:15.819 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtei++ )) 2020-02-08T18:18:15.861 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:15.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:15.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:15.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:15.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:15.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:15.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:15.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:15.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:15.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:15.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:15.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:15.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:15.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:15.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:15.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:15.869 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:15.870 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:18.371 INFO:tasks.workunit.client.0.smithi157.stderr:12st/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:18.371 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:18.371 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:18.371 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:18.371 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:18.371 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.d last_scrub_stamp 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.d 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.d") | .last_scrub_stamp' 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:16.508467+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:18.372 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:18.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:19.004 INFO:tasks.workunit.client.0.smithi157.stderr:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:19.004 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.004 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.004 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.004 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.14 last_scrub_stamp 2020-02-08T18:18:19.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.14 2020-02-08T18:18:19.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.14") | .last_scrub_stamp' 2020-02-08T18:18:19.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:15.023636+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:19.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:19.605 INFO:tasks.workunit.client.0.smithi157.stderr:st/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:19.606 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.607 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.2 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:16.270159+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:19.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:19.624 INFO:tasks.workunit.client.0.smithi157.stderr:st/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:19.624 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:19.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2020-02-08T18:18:19.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.4 2020-02-08T18:18:19.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2020-02-08T18:18:19.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:17.610854+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.628 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:19.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:19.720 INFO:tasks.workunit.client.0.smithi157.stderr:st/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.720 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:19.720 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.720 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.720 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.721 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:19.722 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.722 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.722 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.722 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.722 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:18:19.722 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:18:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:18:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:15.555408+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:19.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:19.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:19.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17024 2020-02-08T18:18:19.779 INFO:tasks.workunit.client.0.smithi157.stderr:st/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.780 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:19.781 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:15.611158+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:19.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:19.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:19.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17031 2020-02-08T18:18:19.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:19.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17038 2020-02-08T18:18:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:st/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.625 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.8 last_scrub_stamp 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.8 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.8") | .last_scrub_stamp' 2020-02-08T18:18:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:16.591368+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.628 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:20.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:st/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.795 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.9 last_scrub_stamp 2020-02-08T18:18:20.796 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.9 2020-02-08T18:18:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.9") | .last_scrub_stamp' 2020-02-08T18:18:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:16.561075+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:20.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:20.861 INFO:tasks.workunit.client.0.smithi157.stderr:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.862 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.863 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:20.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:20.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:20.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.952 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.cliest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.952 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:20.952 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.952 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.952 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:20.953 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:20.954 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:20.955 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:20.956 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:20.956 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:20.956 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:st/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:21.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:21.063 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.065 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:21.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:21.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:21.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.083 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.083 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:21.083 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.083 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.084 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:21.085 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:21.086 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.086 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.086 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:21.086 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.086 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:21.087 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:21.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.195 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.198 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:21.199 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:21.199 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.199 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.199 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:21.199 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.201 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.201 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:21.202 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.203 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.204 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:21.204 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:21.204 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.204 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.204 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:21.205 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.206 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:21.206 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.206 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.491 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.491 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:21.491 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.491 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.491 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.492 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.493 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:21.494 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:21.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:21.495 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.527 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.528 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.529 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:21.530 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:21.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:21.531 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.cliest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:21.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:21.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:21.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:21.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:21.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.692 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:21.692 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.692 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.692 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:21.693 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.694 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:21.695 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:21.696 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.696 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.696 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:21.696 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.cliest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:21.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:21.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:21.769 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.770 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.850 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:21.850 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.851 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.857 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:21.857 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:21.857 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:21.858 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.859 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:21.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:21.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:21.860 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:21.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:21.884 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:21.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.885 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:21.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:21.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.907 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.907 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:21.908 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.908 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.908 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.909 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.909 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:21.909 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:21.909 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.909 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.910 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:21.910 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.910 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.910 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.910 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.910 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.911 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.912 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:21.912 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:21.912 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.912 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.912 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:21.912 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.927 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.cliest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.928 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:21.928 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.928 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.928 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.928 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.928 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:21.929 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:21.929 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.929 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:21.929 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.929 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.930 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:21.931 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.931 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:21.931 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:21.931 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:21.931 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:21.931 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:21.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:21.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:21.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:21.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:21.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.021 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:st/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:22.021 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.021 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.021 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.022 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.022 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.022 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:22.022 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:22.022 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.022 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:22.023 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.023 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.023 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.023 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.023 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.023 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.024 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.025 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:22.025 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:22.025 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.025 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:22.025 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.025 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.030 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.031 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.032 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:22.032 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:22.032 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.032 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:22.032 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.032 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:22.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:22.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:22.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.044 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.cliest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.044 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:22.044 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.044 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.044 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.044 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.045 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.046 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:22.047 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.048 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:22.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.066 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.067 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.068 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:22.069 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.070 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.070 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:22.070 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.cliest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:22.131 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:22.131 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.131 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.131 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:22.131 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.133 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.134 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.134 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:22.135 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:22.135 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.135 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.135 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:22.135 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.184 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.185 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:22.185 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.185 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.185 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.185 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.185 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.186 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:22.187 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.188 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:22.189 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.189 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.190 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.190 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:22.190 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.191 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.191 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.191 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.191 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:22.191 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.192 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.193 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:22.194 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.clie1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.381 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.7 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:18.277124+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.382 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:22.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:22.422 INFO:tasks.workunit.client.0.smithi157.stderr:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:22.423 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:22.423 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:22.423 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:18:22.423 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:18:22.423 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:22.423 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:17.724236+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17045 2020-02-08T18:18:22.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:22.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17052 2020-02-08T18:18:24.050 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.050 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.050 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.050 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.051 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.10 last_scrub_stamp 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.10 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.10") | .last_scrub_stamp' 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:18.678316+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.052 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:24.053 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:24.175 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.175 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.176 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.11 last_scrub_stamp 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.11 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.11") | .last_scrub_stamp' 2020-02-08T18:18:24.177 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:21.238787+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:24.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:24.178 INFO:tasks.workunit.client.0.smithi157.stderr:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.178 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.179 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.c last_scrub_stamp 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.c 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.c") | .last_scrub_stamp' 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:19.663454+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.180 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:24.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:24.646 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:24.647 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:24.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:24.648 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.649 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:24.649 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:24.649 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:24.649 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.12 last_scrub_stamp 2020-02-08T18:18:24.649 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.12 2020-02-08T18:18:24.650 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:24.650 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:24.650 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.12") | .last_scrub_stamp' 2020-02-08T18:18:24.650 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:22.264062+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:25.742 INFO:tasks.workunit.client.0.smithi157.stderr:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:25.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:25.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:25.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:25.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.b last_scrub_stamp 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.b 2020-02-08T18:18:25.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:25.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:25.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.b") | .last_scrub_stamp' 2020-02-08T18:18:25.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:22.475111+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:25.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:25.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:26.500 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.500 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:26.501 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:26.501 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.501 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:26.501 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.502 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.502 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.502 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.502 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.503 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:26.504 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.504 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.504 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.504 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.505 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.505 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:26.505 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:26.505 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.505 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.506 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:26.506 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.506 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.506 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.506 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:26.507 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastnt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.508 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.508 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.508 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:26.508 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:26.509 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.509 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.509 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:26.509 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.509 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.510 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.510 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.510 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:26.510 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.511 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.512 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.512 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:26.512 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:26.512 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.512 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.513 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:26.513 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.513 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.513 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.514 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.514 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastnt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:26.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.548 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.549 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.550 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.551 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:26.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastnt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.577 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:26.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:26.578 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:26.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.579 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:26.582 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:26.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:26.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.583 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.584 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastnt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:26.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.16 last_scrub_stamp 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.16 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.16") | .last_scrub_stamp' 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:24.355135+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:26.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:26.738 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.740 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:26.741 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.742 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.743 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.744 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:26.746 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.a last_scrub_stamp 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.a 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.a") | .last_scrub_stamp' 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:19.543609+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:26.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:26.986 INFO:tasks.workunit.client.0.smithi157.stderr:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.986 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.f last_scrub_stamp 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.f 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.f") | .last_scrub_stamp' 2020-02-08T18:18:26.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:26.990 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:22.314119+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:26.990 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:26.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:27.004 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.005 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:27.006 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:27.007 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:27.008 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.008 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.009 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:27.009 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.009 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.009 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.009 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.010 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:27.058 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastnt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:27.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:27.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:27.610 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.610 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.610 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.610 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.611 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:27.612 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.613 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2020-02-08T18:18:27.614 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.5 2020-02-08T18:18:27.615 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/unt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.615 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.615 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.615 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:27.615 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:27.615 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.616 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.617 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.17 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.618 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.619 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.619 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.619 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.17 last_scrub_stamp 2020-02-08T18:18:27.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastnt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:27.662 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.663 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.664 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:27.665 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.666 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:27.683 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.683 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.683 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.683 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.684 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:27.685 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.686 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:27.687 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/unt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:27.865 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.866 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:27.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:27.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:27.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.867 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.868 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:27.876 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_lastbuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.876 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.876 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2020-02-08T18:18:27.876 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:21.627064+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.876 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:27.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17059 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17066 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17073 2020-02-08T18:18:27.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17078 2020-02-08T18:18:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17085 2020-02-08T18:18:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17094 2020-02-08T18:18:27.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17098 2020-02-08T18:18:27.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17105 2020-02-08T18:18:27.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:27.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17112 2020-02-08T18:18:27.907 INFO:tasks.workunit.client.0.smithi157.stderr:_scrub_stamp: local pgid=1.17 2020-02-08T18:18:27.907 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.907 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.907 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.17") | .last_scrub_stamp' 2020-02-08T18:18:27.908 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:23.274479+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.908 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:27.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:27.982 INFO:tasks.workunit.client.0.smithi157.stderr:nt.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.982 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:27.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:27.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.983 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:27.984 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:27.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:27.985 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.987 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:27.988 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:27.989 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:28.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:28.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:28.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:28.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:28.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:28.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:28.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:28.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:28.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.13 last_scrub_stamp 2020-02-08T18:18:28.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.13 2020-02-08T18:18:28.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:28.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:28.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.13") | .last_scrub_stamp' 2020-02-08T18:18:28.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:22.588048+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:28.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:28.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:28.560 INFO:tasks.workunit.client.0.smithi157.stderr:_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:28.561 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1b last_scrub_stamp 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1b 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1b") | .last_scrub_stamp' 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:28.562 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:24.311573+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:28.563 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:28.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:29.706 INFO:tasks.workunit.client.0.smithi157.stderr:_scrub_stamp: local pgid=1.15 2020-02-08T18:18:29.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.15 last_scrub_stamp 2020-02-08T18:18:29.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.15 2020-02-08T18:18:29.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.15") | .last_scrub_stamp' 2020-02-08T18:18:29.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:27.576859+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.709 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:29.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:29.726 INFO:tasks.workunit.client.0.smithi157.stderr:_scrub_stamp: local pgid=1.19 2020-02-08T18:18:29.726 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.726 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.726 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:29.726 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.727 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.19 last_scrub_stamp 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.19 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.728 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.19") | .last_scrub_stamp' 2020-02-08T18:18:29.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:23.670820+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.729 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:29.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:29.877 INFO:tasks.workunit.client.0.smithi157.stderr:_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:29.877 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:29.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:29.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:29.878 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.879 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1e last_scrub_stamp 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1e 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1e") | .last_scrub_stamp' 2020-02-08T18:18:29.880 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:25.674544+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:29.881 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:29.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:30.467 INFO:tasks.workunit.client.0.smithi157.stderr:buntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:30.467 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:30.468 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:30.468 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:30.468 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:30.468 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:30.468 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:30.469 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:30.469 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:30.469 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:30.469 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:30.469 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:30.470 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:30.470 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:30.470 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:30.470 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:30.471 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.e last_scrub_stamp 2020-02-08T18:18:30.471 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.e 2020-02-08T18:18:30.471 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:30.471 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:30.471 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.e") | .last_scrub_stamp' 2020-02-08T18:18:30.472 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:24.523277+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:30.472 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:30.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:30.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17114 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17127 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17131 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17133 2020-02-08T18:18:30.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17139 2020-02-08T18:18:30.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17145 2020-02-08T18:18:30.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17156 2020-02-08T18:18:30.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17164 2020-02-08T18:18:30.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17173 2020-02-08T18:18:30.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:30.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17180 2020-02-08T18:18:31.058 INFO:tasks.workunit.client.0.smithi157.stderr:_scrub_stamp: local pgid=1.18 2020-02-08T18:18:31.058 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.058 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.058 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:31.058 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:31.059 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:31.060 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:31.061 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:31.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.062 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:31.162 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.163 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.164 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:31.165 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.166 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.167 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:31.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:31.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:31.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.703 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:31.704 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.705 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:31.706 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:31.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:31.707 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:32.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:32.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:32.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:32.033 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:32.034 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.035 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:32.036 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.037 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.037 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:32.137 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:32.137 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.137 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.137 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:32.138 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:32.138 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:32.138 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:32.138 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:32.138 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:32.138 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:32.139 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.139 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.139 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:32.139 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:32.140 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:32.140 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:32.140 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:32.140 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:32.140 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:32.141 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:32.142 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:32.142 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:32.142 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:32.142 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:32.143 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:32.143 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:33.565 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:33.565 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:33.565 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:33.567 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:33.567 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:33.568 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.18 last_scrub_stamp 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.18 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.18") | .last_scrub_stamp' 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:30.724222+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:33.569 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17192 2020-02-08T18:18:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:33.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17198 2020-02-08T18:18:34.642 INFO:tasks.workunit.client.0.smithi157.stderr:/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:34.643 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1f last_scrub_stamp 2020-02-08T18:18:34.644 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1f 2020-02-08T18:18:34.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:34.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:34.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1f") | .last_scrub_stamp' 2020-02-08T18:18:34.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:32.743675+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:34.645 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:34.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:35.891 INFO:tasks.workunit.client.0.smithi157.stderr:/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:35.891 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:35.891 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:35.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:35.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:35.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:35.893 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:35.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:35.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:35.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:35.894 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:35.895 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:35.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:35.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:35.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:35.896 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:35.897 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:35.898 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:35.898 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:35.898 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:35.898 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:35.899 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:35.899 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:35.899 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:35.899 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:35.899 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.129 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1a last_scrub_stamp 2020-02-08T18:18:36.129 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1a 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1a") | .last_scrub_stamp' 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:29.634621+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:36.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17202 2020-02-08T18:18:36.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:36.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17217 2020-02-08T18:18:36.452 INFO:tasks.workunit.client.0.smithi157.stderr:/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.452 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.453 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.454 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:36.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:36.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.455 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:36.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.456 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.764 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.764 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.764 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.764 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.764 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.766 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:36.767 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:36.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:36.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:36.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:36.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:36.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:36.768 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:37.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:37.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:37.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:37.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:37.932 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1c last_scrub_stamp 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1c 2020-02-08T18:18:37.933 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:37.934 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:37.934 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1c") | .last_scrub_stamp' 2020-02-08T18:18:37.934 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:32.373636+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:37.934 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:37.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:37.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:37.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17224 2020-02-08T18:18:39.486 INFO:tasks.workunit.client.0.smithi157.stderr:helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:39.487 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:39.487 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:39.487 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:39.487 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:39.487 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:39.487 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:17:47.439528+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.1d last_scrub_stamp 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.1d 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:18:39.489 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:12840: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1d") | .last_scrub_stamp' 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:18:34.735816+0000 '>' 2020-02-08T18:17:47.439528+0000 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:12840: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1999: run_in_background: return 0 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17233 2020-02-08T18:18:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: wait_background: for pid in $pids 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: wait 17243 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2042: wait_background: eval 'pids='\'''\''' 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2042: wait_background: pids= 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2044: wait_background: return 0 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:73: TEST_recovery_scrub: return_code=0 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:74: TEST_recovery_scrub: '[' 0 -ne 0 ']' 2020-02-08T18:18:39.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:76: TEST_recovery_scrub: ERRORS=0 2020-02-08T18:18:39.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:77: TEST_recovery_scrub: find td/osd-recovery-scrub 2020-02-08T18:18:39.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:77: TEST_recovery_scrub: grep '[^/]*\.pid' 2020-02-08T18:18:39.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:77: TEST_recovery_scrub: pidfile='td/osd-recovery-scrub/osd.6.pid 2020-02-08T18:18:39.493 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.1.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.4.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.2.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/mgr.x.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/mon.a.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.5.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.7.pid 2020-02-08T18:18:39.494 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.3.pid 2020-02-08T18:18:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:td/osd-recovery-scrub/osd.0.pid' 2020-02-08T18:18:39.495 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:78: TEST_recovery_scrub: cat td/osd-recovery-scrub/osd.6.pid td/osd-recovery-scrub/osd.1.pid td/osd-recovery-scrub/osd.4.pid td/osd-recovery-scrub/osd.2.pid td/osd-recovery-scrub/mgr.x.pid td/osd-recovery-scrub/mon.a.pid td/osd-recovery-scrub/osd.5.pid td/osd-recovery-scrub/osd.7.pid td/osd-recovery-scrub/osd.3.pid td/osd-recovery-scrub/osd.0.pid 2020-02-08T18:18:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:78: TEST_recovery_scrub: pid='15531 2020-02-08T18:18:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:13610 2020-02-08T18:18:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:14750 2020-02-08T18:18:39.495 INFO:tasks.workunit.client.0.smithi157.stderr:13988 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:12962 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:12896 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:15154 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:15908 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:14365 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:13188' 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub: kill -0 15531 13610 14750 13988 12962 12896 15154 15908 14365 13188 2020-02-08T18:18:39.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub: kill_daemons td/osd-recovery-scrub 2020-02-08T18:18:39.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:18:39.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:18:39.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:18:39.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:18:39.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:18:39.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:18:39.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:89: TEST_recovery_scrub: declare -a err_strings 2020-02-08T18:18:39.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:90: TEST_recovery_scrub: err_strings[0]='not scheduling scrubs due to active recovery' 2020-02-08T18:18:39.600 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: expr 8 - 1 2020-02-08T18:18:39.600 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: seq 0 7 2020-02-08T18:18:39.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.0.log 2020-02-08T18:18:39.610 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:03.127+0000 7f7a8d43e700 20 osd.0 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.610 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:04.574+0000 7f7a75c0f700 20 osd.0 pg_epoch: 52 pg[1.0( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [7,0,2,3] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.610 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:06.148+0000 7f7a8d43e700 20 osd.0 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.610 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:07.111+0000 7f7a8d43e700 20 osd.0 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.611 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:07.606+0000 7f7a73c0b700 20 osd.0 pg_epoch: 52 pg[1.4( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [3,0,6,1] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.611 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:11.569+0000 7f7a73c0b700 20 osd.0 pg_epoch: 52 pg[1.4( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [3,0,6,1] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.611 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:13.014+0000 7f7a75c0f700 20 osd.0 pg_epoch: 52 pg[1.14( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [2,0,4,5] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.611 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:14.585+0000 7f7a73c0b700 20 osd.0 pg_epoch: 52 pg[1.4( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [3,0,6,1] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.1.log 2020-02-08T18:18:39.616 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:01.574+0000 7f9b2cd39700 20 osd.1 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.616 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:06.619+0000 7f9b2cd39700 20 osd.1 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.616 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:06.709+0000 7f9b13d07700 20 osd.1 pg_epoch: 52 pg[1.3( empty local-lis/les=50/52 n=0 ec=42/42 lis/c=50/50 les/c/f=52/52/0 sis=50) [4,1,2,6] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.616 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:07.606+0000 7f9b13506700 20 osd.1 pg_epoch: 52 pg[1.4( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [3,0,6,1] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.2.log 2020-02-08T18:18:39.621 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:06.709+0000 7fc93d9bb700 20 osd.2 pg_epoch: 52 pg[1.3( empty local-lis/les=50/52 n=0 ec=42/42 lis/c=50/50 les/c/f=52/52/0 sis=50) [4,1,2,6] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.622 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:07.261+0000 7fc93e1bc700 20 osd.2 pg_epoch: 52 pg[1.7( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/51/0 sis=50) [6,7,3,2] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.3.log 2020-02-08T18:18:39.628 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:04.575+0000 7fc8bcca3700 20 osd.3 pg_epoch: 52 pg[1.0( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [7,0,2,3] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.628 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:04.638+0000 7fc8d44d2700 20 osd.3 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.628 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:09.538+0000 7fc8bcca3700 20 osd.3 pg_epoch: 52 pg[1.0( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [7,0,2,3] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.628 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:10.097+0000 7fc8bbca1700 20 osd.3 pg_epoch: 52 pg[1.2( empty local-lis/les=50/52 n=0 ec=42/42 lis/c=50/50 les/c/f=52/52/0 sis=50) [0,7,1,3] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.4.log 2020-02-08T18:18:39.632 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:02.801+0000 7fd251aa3700 20 osd.4 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.632 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:08.559+0000 7fd238270700 20 osd.4 pg_epoch: 52 pg[1.9( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/51/0 sis=50) [1,4,5,2] r=1 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.633 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:08.985+0000 7fd23a274700 20 osd.4 pg_epoch: 52 pg[1.14( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [2,0,4,5] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.633 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:09.792+0000 7fd251aa3700 20 osd.4 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.633 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:11.009+0000 7fd23a274700 20 osd.4 pg_epoch: 52 pg[1.14( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [2,0,4,5] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.5.log 2020-02-08T18:18:39.638 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:05.712+0000 7feadf9c7700 20 osd.5 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.638 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:07.638+0000 7feadf9c7700 20 osd.5 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.638 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:08.559+0000 7feac6194700 20 osd.5 pg_epoch: 52 pg[1.9( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/51/0 sis=50) [1,4,5,2] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.638 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:08.687+0000 7feadf9c7700 20 osd.5 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.638 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:08.985+0000 7feac8198700 20 osd.5 pg_epoch: 52 pg[1.14( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [2,0,4,5] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:10.667+0000 7feadf9c7700 20 osd.5 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:11.009+0000 7feac8198700 20 osd.5 pg_epoch: 52 pg[1.14( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [2,0,4,5] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:11.657+0000 7feadf9c7700 20 osd.5 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:12.623+0000 7feadf9c7700 20 osd.5 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:13.014+0000 7feac8198700 20 osd.5 pg_epoch: 52 pg[1.14( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [2,0,4,5] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:13.558+0000 7feac6194700 20 osd.5 pg_epoch: 52 pg[1.9( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/51/0 sis=50) [1,4,5,2] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.6.log 2020-02-08T18:18:39.640 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:10.308+0000 7f58968c3700 20 osd.6 52 sched_scrub not scheduling scrubs due to active recovery 2020-02-08T18:18:39.641 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:11.569+0000 7f587d090700 20 osd.6 pg_epoch: 52 pg[1.4( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [3,0,6,1] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.641 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:12.827+0000 7f587d891700 20 osd.6 pg_epoch: 52 pg[1.3( empty local-lis/les=50/52 n=0 ec=42/42 lis/c=50/50 les/c/f=52/52/0 sis=50) [4,1,2,6] r=3 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.641 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:18:14.585+0000 7f587d090700 20 osd.6 pg_epoch: 52 pg[1.4( empty local-lis/les=50/51 n=0 ec=42/42 lis/c=50/50 les/c/f=51/52/0 sis=50) [3,0,6,1] r=2 lpr=50 crt=0'0 mlcod 0'0 active mbc={}] handle_scrub_reserve_request: failed to reserve remotely 2020-02-08T18:18:39.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub: grep 'failed to reserve\|not scheduling scrubs' td/osd-recovery-scrub/osd.7.log 2020-02-08T18:18:39.643 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:99: TEST_recovery_scrub: for err_string in "${err_strings[@]}" 2020-02-08T18:18:39.643 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:101: TEST_recovery_scrub: found=false 2020-02-08T18:18:39.644 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: expr 8 - 1 2020-02-08T18:18:39.644 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: seq 0 7 2020-02-08T18:18:39.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.0.log 2020-02-08T18:18:39.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub: found=true 2020-02-08T18:18:39.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.1.log 2020-02-08T18:18:39.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub: found=true 2020-02-08T18:18:39.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.2.log 2020-02-08T18:18:39.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.3.log 2020-02-08T18:18:39.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub: found=true 2020-02-08T18:18:39.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.4.log 2020-02-08T18:18:39.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub: found=true 2020-02-08T18:18:39.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.5.log 2020-02-08T18:18:39.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub: found=true 2020-02-08T18:18:39.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.6.log 2020-02-08T18:18:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub: found=true 2020-02-08T18:18:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub: for osd in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub: grep 'not scheduling scrubs due to active recovery' td/osd-recovery-scrub/osd.7.log 2020-02-08T18:18:39.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:109: TEST_recovery_scrub: '[' true = false ']' 2020-02-08T18:18:39.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:115: TEST_recovery_scrub: teardown td/osd-recovery-scrub 2020-02-08T18:18:39.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-recovery-scrub 2020-02-08T18:18:39.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:18:39.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-recovery-scrub KILL 2020-02-08T18:18:39.655 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:18:39.655 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:18:39.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:18:39.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:18:39.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:18:39.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:18:39.661 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:18:39.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:18:39.662 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:18:39.663 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:18:39.663 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:18:39.663 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:18:39.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:18:39.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:18:39.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:18:39.666 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:18:39.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:18:39.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:18:39.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-recovery-scrub 2020-02-08T18:18:39.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:18:39.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:39.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:18:39.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.12840 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub: '[' 0 '!=' 0 ']' 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:123: TEST_recovery_scrub: echo 'TEST PASSED' 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:124: TEST_recovery_scrub: return 0 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: code=0 2020-02-08T18:18:39.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: teardown td/osd-recovery-scrub 0 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-recovery-scrub 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-recovery-scrub KILL 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:18:39.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:18:39.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:18:39.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:18:39.696 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:18:39.696 INFO:tasks.workunit.client.0.smithi157.stdout:TEST PASSED 2020-02-08T18:18:39.697 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:18:39.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:18:39.699 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:18:39.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:18:39.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-02-08T18:18:39.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-recovery-scrub 2020-02-08T18:18:39.700 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:18:39.700 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:39.700 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.12840 2020-02-08T18:18:39.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.12840 2020-02-08T18:18:39.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:18:39.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:18:39.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: return 0 2020-02-08T18:18:39.702 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-08T18:18:39.702 INFO:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-08T18:18:39.781 INFO:tasks.workunit:Running workunit scrub/osd-scrub-dump.sh... 2020-02-08T18:18:39.782 INFO:teuthology.orchestra.run.smithi157:workunit test scrub/osd-scrub-dump.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f366546002698478e7b1888bb3d9023bb85c3032 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh 2020-02-08T18:18:39.836 INFO:tasks.workunit.client.0.smithi157.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-02-08T18:18:39.843 INFO:tasks.workunit.client.0.smithi157.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-02-08T18:18:39.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-02-08T18:18:39.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: main: export PYTHONWARNINGS=ignore 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: main: PYTHONWARNINGS=ignore 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: main: export CEPH_CONF=/dev/null 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: main: CEPH_CONF=/dev/null 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2141: main: unset CEPH_ARGS 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2143: main: local code 2020-02-08T18:18:39.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: run td/osd-scrub-dump 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:25: run: local dir=td/osd-scrub-dump 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:26: run: shift 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:27: run: local SLEEP=0 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:28: run: local CHUNK_MAX=5 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:30: run: export CEPH_MON=127.0.0.1:7184 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:30: run: CEPH_MON=127.0.0.1:7184 2020-02-08T18:18:39.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:31: run: export CEPH_ARGS 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: uuidgen 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: CEPH_ARGS+='--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none ' 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:33: run: CEPH_ARGS+='--mon-host=127.0.0.1:7184 ' 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:34: run: CEPH_ARGS+='--osd_max_scrubs=4 ' 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:35: run: CEPH_ARGS+='--osd_scrub_sleep=0 ' 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:36: run: CEPH_ARGS+='--osd_scrub_chunk_max=5 ' 2020-02-08T18:18:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:37: run: CEPH_ARGS+='--osd_scrub_sleep=2 ' 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:38: run: CEPH_ARGS+='--osd_pool_default_size=3 ' 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:40: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:41: run: set 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:41: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:41: run: local funcs=TEST_recover_unexpected 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:42: run: for func in $funcs 2020-02-08T18:18:39.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:43: run: setup td/osd-scrub-dump 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-scrub-dump 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-scrub-dump 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-dump 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-dump KILL 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:18:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:18:39.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:18:39.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:18:39.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:18:39.851 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:18:39.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:18:39.851 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:18:39.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:18:39.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:18:39.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:18:39.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-dump 2020-02-08T18:18:39.854 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:18:39.854 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:39.855 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:39.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.29983 2020-02-08T18:18:39.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:18:39.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:18:39.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-scrub-dump 2020-02-08T18:18:39.856 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-02-08T18:18:39.856 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:39.856 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:39.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.29983 2020-02-08T18:18:39.862 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-scrub-dump 1' TERM HUP INT 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:44: run: TEST_recover_unexpected td/osd-scrub-dump 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: TEST_recover_unexpected: local dir=td/osd-scrub-dump 2020-02-08T18:18:39.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: TEST_recover_unexpected: shift 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: TEST_recover_unexpected: local OSDS=6 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:53: TEST_recover_unexpected: local PGS=16 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:54: TEST_recover_unexpected: local POOLS=3 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:55: TEST_recover_unexpected: local OBJS=1000 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:57: TEST_recover_unexpected: run_mon td/osd-scrub-dump a 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-scrub-dump 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-02-08T18:18:39.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-02-08T18:18:39.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-02-08T18:18:39.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-scrub-dump/a 2020-02-08T18:18:39.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-dump/a --run-dir=td/osd-scrub-dump 2020-02-08T18:18:40.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-02-08T18:18:40.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:18:40.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:18:40.202 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:18:40.202 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:40.202 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:40.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:40.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-dump/a '--log-file=td/osd-scrub-dump/$name.log' '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-dump/log --run-dir=td/osd-scrub-dump '--pid-file=td/osd-scrub-dump/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-02-08T18:18:40.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: cat 2020-02-08T18:18:40.344 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a fsid 2020-02-08T18:18:40.345 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:18:40.345 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:18:40.345 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=fsid 2020-02-08T18:18:40.345 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .fsid 2020-02-08T18:18:40.345 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:18:40.345 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-mon.a.asok 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:18:40.349 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.29983/ceph-mon.a.asok config get fsid 2020-02-08T18:18:40.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a mon_host 2020-02-08T18:18:40.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:18:40.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=mon_host 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .mon_host 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:18:40.432 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:40.433 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:40.433 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-mon.a.asok 2020-02-08T18:18:40.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:18:40.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.29983/ceph-mon.a.asok config get mon_host 2020-02-08T18:18:40.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:58: TEST_recover_unexpected: run_mgr td/osd-scrub-dump x 2020-02-08T18:18:40.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:551: run_mgr: local dir=td/osd-scrub-dump 2020-02-08T18:18:40.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: shift 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local id=x 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local data=td/osd-scrub-dump/x 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: get_asok_path 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:18:40.518 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:18:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:40.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:40.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:18:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-dump/x '--log-file=td/osd-scrub-dump/$name.log' '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --run-dir=td/osd-scrub-dump '--pid-file=td/osd-scrub-dump/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:18:41.145 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:18:41.146 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: seq 0 5 2020-02-08T18:18:41.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:41.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:61: TEST_recover_unexpected: run_osd td/osd-scrub-dump 0 2020-02-08T18:18:41.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-dump 2020-02-08T18:18:41.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=0 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-dump/0 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 ' 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:18:41.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-dump/0' 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-dump/0/journal' 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-dump' 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:18:41.155 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:41.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-dump/$name.log' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-dump/$name.pid' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:18:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-dump/0 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=3cdd7302-1786-4e79-9a75-e57039da0004 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd0 3cdd7302-1786-4e79-9a75-e57039da0004' 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:18:41.158 INFO:tasks.workunit.client.0.smithi157.stdout:add osd0 3cdd7302-1786-4e79-9a75-e57039da0004 2020-02-08T18:18:41.183 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCB+z5ewazBChAADSBaakm+Q6omOI3B4+kH+g== 2020-02-08T18:18:41.183 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCB+z5ewazBChAADSBaakm+Q6omOI3B4+kH+g=="}' 2020-02-08T18:18:41.183 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 3cdd7302-1786-4e79-9a75-e57039da0004 -i td/osd-scrub-dump/0/new.json 2020-02-08T18:18:41.459 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:18:41.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-dump/0/new.json 2020-02-08T18:18:41.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 0 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/0 --osd-journal=td/osd-scrub-dump/0/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCB+z5ewazBChAADSBaakm+Q6omOI3B4+kH+g== --osd-uuid 3cdd7302-1786-4e79-9a75-e57039da0004 2020-02-08T18:18:41.499 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.496+0000 7f192b980ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:41.501 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.498+0000 7f192b980ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:41.502 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.500+0000 7f192b980ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:41.503 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.500+0000 7f192b980ec0 -1 bluestore(td/osd-scrub-dump/0/block) _read_bdev_label failed to open td/osd-scrub-dump/0/block: (2) No such file or directory 2020-02-08T18:18:41.503 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.500+0000 7f192b980ec0 -1 bluestore(td/osd-scrub-dump/0/block) _read_bdev_label failed to open td/osd-scrub-dump/0/block: (2) No such file or directory 2020-02-08T18:18:41.504 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.500+0000 7f192b980ec0 -1 bluestore(td/osd-scrub-dump/0/block) _read_bdev_label failed to open td/osd-scrub-dump/0/block: (2) No such file or directory 2020-02-08T18:18:41.551 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:41.548+0000 7f192b980ec0 -1 bluestore(td/osd-scrub-dump/0) _read_fsid unparsable uuid 2020-02-08T18:18:44.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-dump/0/keyring 2020-02-08T18:18:44.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:18:44.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd0 key to auth repository 2020-02-08T18:18:44.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-dump/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:18:44.530 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd0 key to auth repository 2020-02-08T18:18:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.0 2020-02-08T18:18:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:18:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:18:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:18:44.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 0 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/0 --osd-journal=td/osd-scrub-dump/0/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:18:44.753 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.0 2020-02-08T18:18:44.780 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:44.778+0000 7f5240c4aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:44.782 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:44.780+0000 7f5240c4aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:44.784 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:44.782+0000 7f5240c4aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 0 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:45.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:18:45.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:45.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:18:45.004 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:18:45.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:18:45.300 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:45.298+0000 7f5240c4aec0 -1 Falling back to public interface 2020-02-08T18:18:46.050 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:46.049+0000 7f5240c4aec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-08T18:18:46.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:18:46.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:46.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:18:46.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:46.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:18:46.249 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:18:46.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:18:47.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:18:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:18:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:18:47.519 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:18:47.784 INFO:tasks.workunit.client.0.smithi157.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/30375,v1:127.0.0.1:6803/30375] [v2:127.0.0.1:6804/30375,v1:127.0.0.1:6805/30375] exists,up 3cdd7302-1786-4e79-9a75-e57039da0004 2020-02-08T18:18:47.784 INFO:tasks.workunit.client.0.smithi157.stdout:add osd1 9c449fc1-b9d1-43a0-b0c3-d0b7a4a46c85 2020-02-08T18:18:47.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:18:47.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:18:47.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:18:47.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:47.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:61: TEST_recover_unexpected: run_osd td/osd-scrub-dump 1 2020-02-08T18:18:47.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-dump 2020-02-08T18:18:47.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:18:47.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=1 2020-02-08T18:18:47.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-dump/1 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 ' 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-dump/1' 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-dump/1/journal' 2020-02-08T18:18:47.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-dump' 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:18:47.787 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-dump/$name.log' 2020-02-08T18:18:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-dump/$name.pid' 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-dump/1 2020-02-08T18:18:47.789 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:18:47.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=9c449fc1-b9d1-43a0-b0c3-d0b7a4a46c85 2020-02-08T18:18:47.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd1 9c449fc1-b9d1-43a0-b0c3-d0b7a4a46c85' 2020-02-08T18:18:47.790 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:18:47.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCH+z5eQc9YLxAAOaxHNWuirHmLTpLj5POWrg== 2020-02-08T18:18:47.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCH+z5eQc9YLxAAOaxHNWuirHmLTpLj5POWrg=="}' 2020-02-08T18:18:47.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 9c449fc1-b9d1-43a0-b0c3-d0b7a4a46c85 -i td/osd-scrub-dump/1/new.json 2020-02-08T18:18:48.124 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:18:48.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-dump/1/new.json 2020-02-08T18:18:48.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 1 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/1 --osd-journal=td/osd-scrub-dump/1/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCH+z5eQc9YLxAAOaxHNWuirHmLTpLj5POWrg== --osd-uuid 9c449fc1-b9d1-43a0-b0c3-d0b7a4a46c85 2020-02-08T18:18:48.164 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.162+0000 7f8f5d80bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:48.167 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.166+0000 7f8f5d80bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:48.176 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.168+0000 7f8f5d80bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.168+0000 7f8f5d80bec0 -1 bluestore(td/osd-scrub-dump/1/block) _read_bdev_label failed to open td/osd-scrub-dump/1/block: (2) No such file or directory 2020-02-08T18:18:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.169+0000 7f8f5d80bec0 -1 bluestore(td/osd-scrub-dump/1/block) _read_bdev_label failed to open td/osd-scrub-dump/1/block: (2) No such file or directory 2020-02-08T18:18:48.177 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.169+0000 7f8f5d80bec0 -1 bluestore(td/osd-scrub-dump/1/block) _read_bdev_label failed to open td/osd-scrub-dump/1/block: (2) No such file or directory 2020-02-08T18:18:48.240 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:48.238+0000 7f8f5d80bec0 -1 bluestore(td/osd-scrub-dump/1) _read_fsid unparsable uuid 2020-02-08T18:18:51.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-dump/1/keyring 2020-02-08T18:18:51.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:18:51.172 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd1 key to auth repository 2020-02-08T18:18:51.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd1 key to auth repository 2020-02-08T18:18:51.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-dump/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:18:51.471 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.1 2020-02-08T18:18:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.1 2020-02-08T18:18:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:18:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 1 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/1 --osd-journal=td/osd-scrub-dump/1/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:18:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:18:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:18:51.499 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:51.497+0000 7fe38ffb4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:51.501 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:51.499+0000 7fe38ffb4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:51.502 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:51.501+0000 7fe38ffb4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:51.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 1 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=1 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:18:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:51.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:18:51.723 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:18:51.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:18:52.017 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:52.016+0000 7fe38ffb4ec0 -1 Falling back to public interface 2020-02-08T18:18:52.779 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:52.778+0000 7fe38ffb4ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-08T18:18:52.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:18:52.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:52.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:18:52.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:18:52.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:52.969 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:18:53.238 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:18:54.239 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:18:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:18:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:18:54.240 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:18:54.498 INFO:tasks.workunit.client.0.smithi157.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/30752,v1:127.0.0.1:6811/30752] [v2:127.0.0.1:6812/30752,v1:127.0.0.1:6813/30752] exists,up 9c449fc1-b9d1-43a0-b0c3-d0b7a4a46c85 2020-02-08T18:18:54.499 INFO:tasks.workunit.client.0.smithi157.stdout:add osd2 6317ea7a-45fc-4f32-be74-f0b535e3072a 2020-02-08T18:18:54.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:18:54.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:18:54.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:18:54.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:18:54.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:61: TEST_recover_unexpected: run_osd td/osd-scrub-dump 2 2020-02-08T18:18:54.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-dump 2020-02-08T18:18:54.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:18:54.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=2 2020-02-08T18:18:54.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:18:54.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-dump/2 2020-02-08T18:18:54.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 ' 2020-02-08T18:18:54.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:18:54.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:18:54.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:18:54.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-dump/2' 2020-02-08T18:18:54.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-dump/2/journal' 2020-02-08T18:18:54.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:18:54.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:18:54.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-dump' 2020-02-08T18:18:54.503 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:18:54.503 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:18:54.504 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:18:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:18:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:18:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:18:54.504 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:18:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:18:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:18:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:18:54.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-dump/$name.log' 2020-02-08T18:18:54.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-dump/$name.pid' 2020-02-08T18:18:54.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:18:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:18:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:18:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:18:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:18:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-dump/2 2020-02-08T18:18:54.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:18:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=6317ea7a-45fc-4f32-be74-f0b535e3072a 2020-02-08T18:18:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd2 6317ea7a-45fc-4f32-be74-f0b535e3072a' 2020-02-08T18:18:54.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:18:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCO+z5e3KCwHhAAybn7YtHALG8gnIoGuu5OrQ== 2020-02-08T18:18:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCO+z5e3KCwHhAAybn7YtHALG8gnIoGuu5OrQ=="}' 2020-02-08T18:18:54.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 6317ea7a-45fc-4f32-be74-f0b535e3072a -i td/osd-scrub-dump/2/new.json 2020-02-08T18:18:54.870 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:18:54.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-dump/2/new.json 2020-02-08T18:18:54.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 2 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/2 --osd-journal=td/osd-scrub-dump/2/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCO+z5e3KCwHhAAybn7YtHALG8gnIoGuu5OrQ== --osd-uuid 6317ea7a-45fc-4f32-be74-f0b535e3072a 2020-02-08T18:18:54.911 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.909+0000 7f6bcc3a2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:54.912 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.911+0000 7f6bcc3a2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:54.913 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.912+0000 7f6bcc3a2ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:54.914 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.912+0000 7f6bcc3a2ec0 -1 bluestore(td/osd-scrub-dump/2/block) _read_bdev_label failed to open td/osd-scrub-dump/2/block: (2) No such file or directory 2020-02-08T18:18:54.914 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.912+0000 7f6bcc3a2ec0 -1 bluestore(td/osd-scrub-dump/2/block) _read_bdev_label failed to open td/osd-scrub-dump/2/block: (2) No such file or directory 2020-02-08T18:18:54.914 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.912+0000 7f6bcc3a2ec0 -1 bluestore(td/osd-scrub-dump/2/block) _read_bdev_label failed to open td/osd-scrub-dump/2/block: (2) No such file or directory 2020-02-08T18:18:54.961 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:54.960+0000 7f6bcc3a2ec0 -1 bluestore(td/osd-scrub-dump/2) _read_fsid unparsable uuid 2020-02-08T18:18:57.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-dump/2/keyring 2020-02-08T18:18:57.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:18:57.931 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd2 key to auth repository 2020-02-08T18:18:57.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd2 key to auth repository 2020-02-08T18:18:57.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-dump/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:18:58.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.2 2020-02-08T18:18:58.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 2 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/2 --osd-journal=td/osd-scrub-dump/2/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:18:58.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:18:58.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:18:58.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:18:58.241 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.2 2020-02-08T18:18:58.267 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:58.266+0000 7fbc91d41ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:58.269 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:58.268+0000 7fbc91d41ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:58.271 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:58.270+0000 7fbc91d41ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:18:58.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 2 2020-02-08T18:18:58.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:18:58.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=2 2020-02-08T18:18:58.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:18:58.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:18:58.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:58.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:18:58.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:58.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:18:58.489 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:18:58.737 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:18:58.791 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:58.790+0000 7fbc91d41ec0 -1 Falling back to public interface 2020-02-08T18:18:59.559 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:18:59.558+0000 7fbc91d41ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-02-08T18:18:59.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:18:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:18:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:18:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:18:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:18:59.739 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:18:59.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:00.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:01.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:01.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:19:01.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:01.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:19:01.000 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:19:01.262 INFO:tasks.workunit.client.0.smithi157.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/31129,v1:127.0.0.1:6819/31129] [v2:127.0.0.1:6820/31129,v1:127.0.0.1:6821/31129] exists,up 6317ea7a-45fc-4f32-be74-f0b535e3072a 2020-02-08T18:19:01.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:19:01.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:19:01.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:19:01.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:19:01.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:61: TEST_recover_unexpected: run_osd td/osd-scrub-dump 3 2020-02-08T18:19:01.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-dump 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=3 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-dump/3 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 ' 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:19:01.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-dump/3' 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-dump/3/journal' 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-dump' 2020-02-08T18:19:01.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:19:01.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-dump/$name.log' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-dump/$name.pid' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:19:01.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:19:01.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:19:01.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:19:01.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:19:01.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-dump/3 2020-02-08T18:19:01.269 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:19:01.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=455a49c6-bb4f-4c1a-89e2-c26508f4fe90 2020-02-08T18:19:01.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd3 455a49c6-bb4f-4c1a-89e2-c26508f4fe90' 2020-02-08T18:19:01.269 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:19:01.270 INFO:tasks.workunit.client.0.smithi157.stdout:add osd3 455a49c6-bb4f-4c1a-89e2-c26508f4fe90 2020-02-08T18:19:01.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCV+z5eLvTHEBAA9dIMvXp3OsCH/IpI4DhV3g== 2020-02-08T18:19:01.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCV+z5eLvTHEBAA9dIMvXp3OsCH/IpI4DhV3g=="}' 2020-02-08T18:19:01.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 455a49c6-bb4f-4c1a-89e2-c26508f4fe90 -i td/osd-scrub-dump/3/new.json 2020-02-08T18:19:01.668 INFO:tasks.workunit.client.0.smithi157.stdout:3 2020-02-08T18:19:01.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-dump/3/new.json 2020-02-08T18:19:01.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 3 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/3 --osd-journal=td/osd-scrub-dump/3/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCV+z5eLvTHEBAA9dIMvXp3OsCH/IpI4DhV3g== --osd-uuid 455a49c6-bb4f-4c1a-89e2-c26508f4fe90 2020-02-08T18:19:01.708 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.707+0000 7fa4e5a90ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:01.710 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.709+0000 7fa4e5a90ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:01.711 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.710+0000 7fa4e5a90ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:01.712 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.710+0000 7fa4e5a90ec0 -1 bluestore(td/osd-scrub-dump/3/block) _read_bdev_label failed to open td/osd-scrub-dump/3/block: (2) No such file or directory 2020-02-08T18:19:01.712 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.710+0000 7fa4e5a90ec0 -1 bluestore(td/osd-scrub-dump/3/block) _read_bdev_label failed to open td/osd-scrub-dump/3/block: (2) No such file or directory 2020-02-08T18:19:01.712 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.710+0000 7fa4e5a90ec0 -1 bluestore(td/osd-scrub-dump/3/block) _read_bdev_label failed to open td/osd-scrub-dump/3/block: (2) No such file or directory 2020-02-08T18:19:01.767 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:01.765+0000 7fa4e5a90ec0 -1 bluestore(td/osd-scrub-dump/3) _read_fsid unparsable uuid 2020-02-08T18:19:04.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-dump/3/keyring 2020-02-08T18:19:04.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:19:04.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd3 key to auth repository 2020-02-08T18:19:04.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-dump/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:19:04.911 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd3 key to auth repository 2020-02-08T18:19:05.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.3 2020-02-08T18:19:05.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 3 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/3 --osd-journal=td/osd-scrub-dump/3/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:19:05.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:19:05.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:19:05.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:19:05.229 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.3 2020-02-08T18:19:05.256 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:05.254+0000 7fc57cb6fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:05.257 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:05.256+0000 7fc57cb6fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:05.258 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:05.257+0000 7fc57cb6fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:05.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 3 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=3 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:19:05.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:05.478 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.3 up' 2020-02-08T18:19:05.478 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:19:05.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:05.775 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:05.774+0000 7fc57cb6fec0 -1 Falling back to public interface 2020-02-08T18:19:06.561 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:06.559+0000 7fc57cb6fec0 -1 osd.3 0 log_to_monitors {default=true} 2020-02-08T18:19:06.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:06.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:06.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:19:06.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:06.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.3 up' 2020-02-08T18:19:06.730 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:19:07.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:19:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:08.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.3 up' 2020-02-08T18:19:08.014 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:19:08.270 INFO:tasks.workunit.client.0.smithi157.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/31515,v1:127.0.0.1:6827/31515] [v2:127.0.0.1:6828/31515,v1:127.0.0.1:6829/31515] exists,up 455a49c6-bb4f-4c1a-89e2-c26508f4fe90 2020-02-08T18:19:08.270 INFO:tasks.workunit.client.0.smithi157.stdout:add osd4 7df295b7-f305-4d77-a4b0-9eaaf4a3f331 2020-02-08T18:19:08.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:19:08.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:19:08.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:19:08.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:19:08.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:61: TEST_recover_unexpected: run_osd td/osd-scrub-dump 4 2020-02-08T18:19:08.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-dump 2020-02-08T18:19:08.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:19:08.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=4 2020-02-08T18:19:08.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:19:08.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-dump/4 2020-02-08T18:19:08.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 ' 2020-02-08T18:19:08.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:19:08.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:19:08.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:19:08.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-dump/4' 2020-02-08T18:19:08.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-dump/4/journal' 2020-02-08T18:19:08.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:19:08.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:19:08.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-dump' 2020-02-08T18:19:08.278 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:19:08.278 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:19:08.278 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:19:08.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-dump/$name.log' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-dump/$name.pid' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:19:08.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:19:08.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-dump/4 2020-02-08T18:19:08.281 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:19:08.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=7df295b7-f305-4d77-a4b0-9eaaf4a3f331 2020-02-08T18:19:08.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd4 7df295b7-f305-4d77-a4b0-9eaaf4a3f331' 2020-02-08T18:19:08.281 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:19:08.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCc+z5e1jLtEBAA8lggy21/ywIgPZ/tNIGjZA== 2020-02-08T18:19:08.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCc+z5e1jLtEBAA8lggy21/ywIgPZ/tNIGjZA=="}' 2020-02-08T18:19:08.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 7df295b7-f305-4d77-a4b0-9eaaf4a3f331 -i td/osd-scrub-dump/4/new.json 2020-02-08T18:19:08.658 INFO:tasks.workunit.client.0.smithi157.stdout:4 2020-02-08T18:19:08.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-dump/4/new.json 2020-02-08T18:19:08.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 4 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/4 --osd-journal=td/osd-scrub-dump/4/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCc+z5e1jLtEBAA8lggy21/ywIgPZ/tNIGjZA== --osd-uuid 7df295b7-f305-4d77-a4b0-9eaaf4a3f331 2020-02-08T18:19:08.698 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.696+0000 7f8e2ea01ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:08.724 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.722+0000 7f8e2ea01ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:08.726 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.724+0000 7f8e2ea01ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:08.726 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.725+0000 7f8e2ea01ec0 -1 bluestore(td/osd-scrub-dump/4/block) _read_bdev_label failed to open td/osd-scrub-dump/4/block: (2) No such file or directory 2020-02-08T18:19:08.727 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.725+0000 7f8e2ea01ec0 -1 bluestore(td/osd-scrub-dump/4/block) _read_bdev_label failed to open td/osd-scrub-dump/4/block: (2) No such file or directory 2020-02-08T18:19:08.727 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.725+0000 7f8e2ea01ec0 -1 bluestore(td/osd-scrub-dump/4/block) _read_bdev_label failed to open td/osd-scrub-dump/4/block: (2) No such file or directory 2020-02-08T18:19:08.782 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:08.780+0000 7f8e2ea01ec0 -1 bluestore(td/osd-scrub-dump/4) _read_fsid unparsable uuid 2020-02-08T18:19:11.874 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-dump/4/keyring 2020-02-08T18:19:11.875 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:19:11.876 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd4 key to auth repository 2020-02-08T18:19:11.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd4 key to auth repository 2020-02-08T18:19:11.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-dump/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:19:12.186 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.4 2020-02-08T18:19:12.186 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.4 2020-02-08T18:19:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:19:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:19:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:19:12.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 4 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/4 --osd-journal=td/osd-scrub-dump/4/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:19:12.214 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:12.212+0000 7f54ac17eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:12.215 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:12.214+0000 7f54ac17eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:12.217 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:12.215+0000 7f54ac17eec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:12.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 4 2020-02-08T18:19:12.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=4 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:12.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:19:12.437 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:19:12.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:12.733 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:12.732+0000 7f54ac17eec0 -1 Falling back to public interface 2020-02-08T18:19:13.481 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:13.479+0000 7f54ac17eec0 -1 osd.4 0 log_to_monitors {default=true} 2020-02-08T18:19:13.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:13.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:13.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:19:13.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:19:13.687 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:13.687 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:19:13.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:14.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:14.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:14.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:19:14.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:14.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.4 up' 2020-02-08T18:19:14.943 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:19:15.199 INFO:tasks.workunit.client.0.smithi157.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/31899,v1:127.0.0.1:6835/31899] [v2:127.0.0.1:6836/31899,v1:127.0.0.1:6837/31899] exists,up 7df295b7-f305-4d77-a4b0-9eaaf4a3f331 2020-02-08T18:19:15.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:59: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:61: TEST_recover_unexpected: run_osd td/osd-scrub-dump 5 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-dump 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:19:15.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=5 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-dump/5 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 ' 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:19:15.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-dump/5' 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-dump/5/journal' 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-dump' 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:19:15.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:19:15.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:19:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:19:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-dump/$name.log' 2020-02-08T18:19:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-dump/$name.pid' 2020-02-08T18:19:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:19:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:19:15.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:19:15.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:19:15.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+= 2020-02-08T18:19:15.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-dump/5 2020-02-08T18:19:15.206 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:19:15.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=34e8d9d1-37e3-47b9-9e71-f6d994171092 2020-02-08T18:19:15.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd5 34e8d9d1-37e3-47b9-9e71-f6d994171092' 2020-02-08T18:19:15.207 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:19:15.207 INFO:tasks.workunit.client.0.smithi157.stdout:add osd5 34e8d9d1-37e3-47b9-9e71-f6d994171092 2020-02-08T18:19:15.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCj+z5e3Dn/DBAA8nSviL31R6c3l+e2mAefUg== 2020-02-08T18:19:15.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCj+z5e3Dn/DBAA8nSviL31R6c3l+e2mAefUg=="}' 2020-02-08T18:19:15.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 34e8d9d1-37e3-47b9-9e71-f6d994171092 -i td/osd-scrub-dump/5/new.json 2020-02-08T18:19:15.598 INFO:tasks.workunit.client.0.smithi157.stdout:5 2020-02-08T18:19:15.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-dump/5/new.json 2020-02-08T18:19:15.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 5 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/5 --osd-journal=td/osd-scrub-dump/5/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCj+z5e3Dn/DBAA8nSviL31R6c3l+e2mAefUg== --osd-uuid 34e8d9d1-37e3-47b9-9e71-f6d994171092 2020-02-08T18:19:15.639 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.636+0000 7fcee9c94ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:15.640 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.638+0000 7fcee9c94ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:15.641 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.639+0000 7fcee9c94ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:15.642 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.639+0000 7fcee9c94ec0 -1 bluestore(td/osd-scrub-dump/5/block) _read_bdev_label failed to open td/osd-scrub-dump/5/block: (2) No such file or directory 2020-02-08T18:19:15.642 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.639+0000 7fcee9c94ec0 -1 bluestore(td/osd-scrub-dump/5/block) _read_bdev_label failed to open td/osd-scrub-dump/5/block: (2) No such file or directory 2020-02-08T18:19:15.642 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.639+0000 7fcee9c94ec0 -1 bluestore(td/osd-scrub-dump/5/block) _read_bdev_label failed to open td/osd-scrub-dump/5/block: (2) No such file or directory 2020-02-08T18:19:15.697 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:15.695+0000 7fcee9c94ec0 -1 bluestore(td/osd-scrub-dump/5) _read_fsid unparsable uuid 2020-02-08T18:19:18.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-dump/5/keyring 2020-02-08T18:19:18.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:19:18.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd5 key to auth repository 2020-02-08T18:19:18.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-dump/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:19:18.767 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd5 key to auth repository 2020-02-08T18:19:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.5 2020-02-08T18:19:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:19:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:19:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:19:19.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 5 --fsid=63d41c0b-9672-4981-b219-8abcfed63dcd --auth-supported=none --mon-host=127.0.0.1:7184 --osd_max_scrubs=4 --osd_scrub_sleep=0 --osd_scrub_chunk_max=5 --osd_scrub_sleep=2 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-dump/5 --osd-journal=td/osd-scrub-dump/5/journal --chdir= --run-dir=td/osd-scrub-dump '--admin-socket=/tmp/ceph-asok.29983/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-dump/$name.log' '--pid-file=td/osd-scrub-dump/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:19:19.084 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.5 2020-02-08T18:19:19.111 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:19.108+0000 7faa4fd61ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:19.112 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:19.110+0000 7faa4fd61ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:19.115 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:19.112+0000 7faa4fd61ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:19:19.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 5 2020-02-08T18:19:19.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:19:19.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=5 2020-02-08T18:19:19.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:19:19.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:19:19.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:19.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:19:19.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:19.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.5 up' 2020-02-08T18:19:19.333 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:19:19.576 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:19.630 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:19.627+0000 7faa4fd61ec0 -1 Falling back to public interface 2020-02-08T18:19:20.346 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:19:20.344+0000 7faa4fd61ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-02-08T18:19:20.577 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:20.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:20.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:19:20.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:20.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.5 up' 2020-02-08T18:19:20.578 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:19:20.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:19:21.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:19:21.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:19:21.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:19:21.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:19:21.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.5 up' 2020-02-08T18:19:21.839 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:19:22.087 INFO:tasks.workunit.client.0.smithi157.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/32276,v1:127.0.0.1:6843/32276] [v2:127.0.0.1:6844/32276,v1:127.0.0.1:6845/32276] exists,up 34e8d9d1-37e3-47b9-9e71-f6d994171092 2020-02-08T18:19:22.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:19:22.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:19:22.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:19:22.088 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:64: TEST_recover_unexpected: seq 1 3 2020-02-08T18:19:22.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:64: TEST_recover_unexpected: for i in $(seq 1 $POOLS) 2020-02-08T18:19:22.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:66: TEST_recover_unexpected: create_pool test1 16 16 2020-02-08T18:19:22.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:539: create_pool: ceph osd pool create test1 16 16 2020-02-08T18:19:22.467 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'test1' created 2020-02-08T18:19:22.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: sleep 1 2020-02-08T18:19:23.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:64: TEST_recover_unexpected: for i in $(seq 1 $POOLS) 2020-02-08T18:19:23.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:66: TEST_recover_unexpected: create_pool test2 16 16 2020-02-08T18:19:23.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:539: create_pool: ceph osd pool create test2 16 16 2020-02-08T18:19:23.998 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'test2' created 2020-02-08T18:19:24.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: sleep 1 2020-02-08T18:19:25.008 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:64: TEST_recover_unexpected: for i in $(seq 1 $POOLS) 2020-02-08T18:19:25.008 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:66: TEST_recover_unexpected: create_pool test3 16 16 2020-02-08T18:19:25.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:539: create_pool: ceph osd pool create test3 16 16 2020-02-08T18:19:25.480 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'test3' created 2020-02-08T18:19:25.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: sleep 1 2020-02-08T18:19:26.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:69: TEST_recover_unexpected: wait_for_clean 2020-02-08T18:19:26.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:19:26.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:19:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:19:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:19:26.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:19:26.493 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:19:26.493 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:19:26.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:19:26.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:19:26.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:19:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:19:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:19:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:19:26.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:19:26.582 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:19:26.978 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:19:26.978 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:19:26.978 INFO:tasks.workunit.client.0.smithi157.stderr:2 2020-02-08T18:19:26.978 INFO:tasks.workunit.client.0.smithi157.stderr:3 2020-02-08T18:19:26.979 INFO:tasks.workunit.client.0.smithi157.stderr:4 2020-02-08T18:19:26.979 INFO:tasks.workunit.client.0.smithi157.stderr:5' 2020-02-08T18:19:26.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:19:26.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:19:26.979 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:19:27.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=21474836489 2020-02-08T18:19:27.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836489' 2020-02-08T18:19:27.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:19:27.098 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:19:27.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672968 2020-02-08T18:19:27.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836489 1-42949672968' 2020-02-08T18:19:27.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:19:27.218 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:19:27.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509448 2020-02-08T18:19:27.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509448' 2020-02-08T18:19:27.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:19:27.335 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2020-02-08T18:19:27.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=85899345925 2020-02-08T18:19:27.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509448 3-85899345925' 2020-02-08T18:19:27.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:19:27.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2020-02-08T18:19:27.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=107374182404 2020-02-08T18:19:27.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509448 3-85899345925 4-107374182404' 2020-02-08T18:19:27.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:19:27.571 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2020-02-08T18:19:27.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=128849018883 2020-02-08T18:19:27.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-64424509448 3-85899345925 4-107374182404 5-128849018883' 2020-02-08T18:19:27.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:19:27.689 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-21474836489 2020-02-08T18:19:27.689 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:19:27.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:19:27.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-21474836489 2020-02-08T18:19:27.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:19:27.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=21474836489 2020-02-08T18:19:27.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2020-02-08T18:19:27.692 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.0 seq 21474836489 2020-02-08T18:19:27.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:19:27.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836488 -lt 21474836489 2020-02-08T18:19:27.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:19:28.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:19:28.940 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:19:29.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836490 -lt 21474836489 2020-02-08T18:19:29.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:19:29.199 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672968 2020-02-08T18:19:29.199 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:19:29.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:19:29.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672968 2020-02-08T18:19:29.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:19:29.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672968 2020-02-08T18:19:29.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2020-02-08T18:19:29.202 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.1 seq 42949672968 2020-02-08T18:19:29.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:19:29.451 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672968 -lt 42949672968 2020-02-08T18:19:29.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:19:29.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509448 2020-02-08T18:19:29.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:19:29.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:19:29.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509448 2020-02-08T18:19:29.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:19:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509448 2020-02-08T18:19:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2020-02-08T18:19:29.456 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.2 seq 64424509448 2020-02-08T18:19:29.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:19:29.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509448 -lt 64424509448 2020-02-08T18:19:29.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:19:29.705 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 3-85899345925 2020-02-08T18:19:29.705 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:19:29.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=3 2020-02-08T18:19:29.707 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 3-85899345925 2020-02-08T18:19:29.707 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:19:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=85899345925 2020-02-08T18:19:29.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.3 seq 85899345925' 2020-02-08T18:19:29.708 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.3 seq 85899345925 2020-02-08T18:19:29.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 3 2020-02-08T18:19:29.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 85899345926 -lt 85899345925 2020-02-08T18:19:29.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:19:29.954 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 4-107374182404 2020-02-08T18:19:29.954 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:19:29.955 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=4 2020-02-08T18:19:29.956 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 4-107374182404 2020-02-08T18:19:29.956 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:19:29.957 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=107374182404 2020-02-08T18:19:29.957 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.4 seq 107374182404' 2020-02-08T18:19:29.957 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.4 seq 107374182404 2020-02-08T18:19:29.958 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 4 2020-02-08T18:19:30.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 107374182404 -lt 107374182404 2020-02-08T18:19:30.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:19:30.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 5-128849018883 2020-02-08T18:19:30.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:19:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=5 2020-02-08T18:19:30.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 5-128849018883 2020-02-08T18:19:30.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:19:30.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=128849018883 2020-02-08T18:19:30.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.5 seq 128849018883' 2020-02-08T18:19:30.211 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.5 seq 128849018883 2020-02-08T18:19:30.211 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 5 2020-02-08T18:19:30.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 128849018883 -lt 128849018883 2020-02-08T18:19:30.460 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:19:30.461 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:19:30.461 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:19:30.761 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 48 == 0 2020-02-08T18:19:30.761 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:19:30.762 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:19:30.762 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:19:30.762 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:19:30.762 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:19:30.763 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:19:30.763 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:19:31.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=48 2020-02-08T18:19:31.008 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:19:31.008 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:19:31.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:19:31.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 48 = 48 2020-02-08T18:19:31.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:19:31.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:19:31.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:71: TEST_recover_unexpected: dd if=/dev/urandom of=datafile bs=4k count=2 2020-02-08T18:19:31.306 INFO:tasks.workunit.client.0.smithi157.stderr:2+0 records in 2020-02-08T18:19:31.306 INFO:tasks.workunit.client.0.smithi157.stderr:2+0 records out 2020-02-08T18:19:31.306 INFO:tasks.workunit.client.0.smithi157.stderr:8192 bytes (8.2 kB, 8.0 KiB) copied, 9.452e-05 s, 86.7 MB/s 2020-02-08T18:19:31.307 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:72: TEST_recover_unexpected: seq 1 3 2020-02-08T18:19:31.307 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:72: TEST_recover_unexpected: for i in $(seq 1 $POOLS) 2020-02-08T18:19:31.308 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: seq 1 1000 2020-02-08T18:19:31.309 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.309 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj1 datafile 2020-02-08T18:19:31.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj2 datafile 2020-02-08T18:19:31.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj3 datafile 2020-02-08T18:19:31.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj4 datafile 2020-02-08T18:19:31.604 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.604 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj5 datafile 2020-02-08T18:19:31.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj6 datafile 2020-02-08T18:19:31.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj7 datafile 2020-02-08T18:19:31.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj8 datafile 2020-02-08T18:19:31.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj9 datafile 2020-02-08T18:19:31.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:31.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj10 datafile 2020-02-08T18:19:32.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj11 datafile 2020-02-08T18:19:32.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj12 datafile 2020-02-08T18:19:32.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj13 datafile 2020-02-08T18:19:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj14 datafile 2020-02-08T18:19:32.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj15 datafile 2020-02-08T18:19:32.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj16 datafile 2020-02-08T18:19:32.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj17 datafile 2020-02-08T18:19:32.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj18 datafile 2020-02-08T18:19:32.614 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.614 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj19 datafile 2020-02-08T18:19:32.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj20 datafile 2020-02-08T18:19:32.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj21 datafile 2020-02-08T18:19:32.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj22 datafile 2020-02-08T18:19:32.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj23 datafile 2020-02-08T18:19:32.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:32.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj24 datafile 2020-02-08T18:19:33.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj25 datafile 2020-02-08T18:19:33.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj26 datafile 2020-02-08T18:19:33.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj27 datafile 2020-02-08T18:19:33.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj28 datafile 2020-02-08T18:19:33.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj29 datafile 2020-02-08T18:19:33.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj30 datafile 2020-02-08T18:19:33.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj31 datafile 2020-02-08T18:19:33.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj32 datafile 2020-02-08T18:19:33.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj33 datafile 2020-02-08T18:19:33.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj34 datafile 2020-02-08T18:19:33.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj35 datafile 2020-02-08T18:19:33.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj36 datafile 2020-02-08T18:19:33.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj37 datafile 2020-02-08T18:19:33.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj38 datafile 2020-02-08T18:19:33.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj39 datafile 2020-02-08T18:19:33.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:33.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj40 datafile 2020-02-08T18:19:34.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj41 datafile 2020-02-08T18:19:34.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj42 datafile 2020-02-08T18:19:34.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj43 datafile 2020-02-08T18:19:34.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj44 datafile 2020-02-08T18:19:34.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj45 datafile 2020-02-08T18:19:34.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj46 datafile 2020-02-08T18:19:34.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj47 datafile 2020-02-08T18:19:34.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj48 datafile 2020-02-08T18:19:34.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj49 datafile 2020-02-08T18:19:34.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj50 datafile 2020-02-08T18:19:34.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj51 datafile 2020-02-08T18:19:34.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj52 datafile 2020-02-08T18:19:34.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj53 datafile 2020-02-08T18:19:34.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:34.972 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj54 datafile 2020-02-08T18:19:35.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj55 datafile 2020-02-08T18:19:35.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj56 datafile 2020-02-08T18:19:35.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj57 datafile 2020-02-08T18:19:35.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj58 datafile 2020-02-08T18:19:35.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj59 datafile 2020-02-08T18:19:35.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj60 datafile 2020-02-08T18:19:35.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj61 datafile 2020-02-08T18:19:35.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj62 datafile 2020-02-08T18:19:35.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj63 datafile 2020-02-08T18:19:35.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj64 datafile 2020-02-08T18:19:35.772 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj65 datafile 2020-02-08T18:19:35.814 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj66 datafile 2020-02-08T18:19:35.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj67 datafile 2020-02-08T18:19:35.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:35.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj68 datafile 2020-02-08T18:19:36.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj69 datafile 2020-02-08T18:19:36.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.065 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj70 datafile 2020-02-08T18:19:36.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj71 datafile 2020-02-08T18:19:36.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj72 datafile 2020-02-08T18:19:36.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj73 datafile 2020-02-08T18:19:36.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj74 datafile 2020-02-08T18:19:36.415 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.415 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj75 datafile 2020-02-08T18:19:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj76 datafile 2020-02-08T18:19:36.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj77 datafile 2020-02-08T18:19:36.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj78 datafile 2020-02-08T18:19:36.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj79 datafile 2020-02-08T18:19:36.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj80 datafile 2020-02-08T18:19:36.806 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.806 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj81 datafile 2020-02-08T18:19:36.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj82 datafile 2020-02-08T18:19:36.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj83 datafile 2020-02-08T18:19:36.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:36.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj84 datafile 2020-02-08T18:19:37.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj85 datafile 2020-02-08T18:19:37.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj86 datafile 2020-02-08T18:19:37.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj87 datafile 2020-02-08T18:19:37.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj88 datafile 2020-02-08T18:19:37.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj89 datafile 2020-02-08T18:19:37.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj90 datafile 2020-02-08T18:19:37.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj91 datafile 2020-02-08T18:19:37.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj92 datafile 2020-02-08T18:19:37.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj93 datafile 2020-02-08T18:19:37.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj94 datafile 2020-02-08T18:19:37.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj95 datafile 2020-02-08T18:19:37.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj96 datafile 2020-02-08T18:19:37.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj97 datafile 2020-02-08T18:19:37.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj98 datafile 2020-02-08T18:19:37.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:37.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj99 datafile 2020-02-08T18:19:38.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.035 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj100 datafile 2020-02-08T18:19:38.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj101 datafile 2020-02-08T18:19:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj102 datafile 2020-02-08T18:19:38.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj103 datafile 2020-02-08T18:19:38.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj104 datafile 2020-02-08T18:19:38.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj105 datafile 2020-02-08T18:19:38.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj106 datafile 2020-02-08T18:19:38.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj107 datafile 2020-02-08T18:19:38.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj108 datafile 2020-02-08T18:19:38.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj109 datafile 2020-02-08T18:19:38.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj110 datafile 2020-02-08T18:19:38.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj111 datafile 2020-02-08T18:19:38.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:38.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj112 datafile 2020-02-08T18:19:39.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj113 datafile 2020-02-08T18:19:39.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj114 datafile 2020-02-08T18:19:39.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj115 datafile 2020-02-08T18:19:39.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj116 datafile 2020-02-08T18:19:39.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj117 datafile 2020-02-08T18:19:39.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj118 datafile 2020-02-08T18:19:39.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj119 datafile 2020-02-08T18:19:39.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj120 datafile 2020-02-08T18:19:39.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj121 datafile 2020-02-08T18:19:39.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj122 datafile 2020-02-08T18:19:39.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj123 datafile 2020-02-08T18:19:39.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj124 datafile 2020-02-08T18:19:39.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj125 datafile 2020-02-08T18:19:39.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj126 datafile 2020-02-08T18:19:39.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj127 datafile 2020-02-08T18:19:39.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj128 datafile 2020-02-08T18:19:39.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj129 datafile 2020-02-08T18:19:39.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj130 datafile 2020-02-08T18:19:39.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:39.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj131 datafile 2020-02-08T18:19:40.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj132 datafile 2020-02-08T18:19:40.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj133 datafile 2020-02-08T18:19:40.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj134 datafile 2020-02-08T18:19:40.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj135 datafile 2020-02-08T18:19:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj136 datafile 2020-02-08T18:19:40.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj137 datafile 2020-02-08T18:19:40.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj138 datafile 2020-02-08T18:19:40.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj139 datafile 2020-02-08T18:19:40.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj140 datafile 2020-02-08T18:19:40.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj141 datafile 2020-02-08T18:19:40.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj142 datafile 2020-02-08T18:19:40.840 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.840 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj143 datafile 2020-02-08T18:19:40.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj144 datafile 2020-02-08T18:19:40.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:40.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj145 datafile 2020-02-08T18:19:41.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj146 datafile 2020-02-08T18:19:41.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.081 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj147 datafile 2020-02-08T18:19:41.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj148 datafile 2020-02-08T18:19:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj149 datafile 2020-02-08T18:19:41.310 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.310 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj150 datafile 2020-02-08T18:19:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj151 datafile 2020-02-08T18:19:41.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj152 datafile 2020-02-08T18:19:41.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj153 datafile 2020-02-08T18:19:41.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj154 datafile 2020-02-08T18:19:41.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj155 datafile 2020-02-08T18:19:41.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj156 datafile 2020-02-08T18:19:41.820 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.820 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj157 datafile 2020-02-08T18:19:41.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj158 datafile 2020-02-08T18:19:41.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj159 datafile 2020-02-08T18:19:41.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:41.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj160 datafile 2020-02-08T18:19:42.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj161 datafile 2020-02-08T18:19:42.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj162 datafile 2020-02-08T18:19:42.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj163 datafile 2020-02-08T18:19:42.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj164 datafile 2020-02-08T18:19:42.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj165 datafile 2020-02-08T18:19:42.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj166 datafile 2020-02-08T18:19:42.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj167 datafile 2020-02-08T18:19:42.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj168 datafile 2020-02-08T18:19:42.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj169 datafile 2020-02-08T18:19:42.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj170 datafile 2020-02-08T18:19:42.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj171 datafile 2020-02-08T18:19:42.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj172 datafile 2020-02-08T18:19:42.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj173 datafile 2020-02-08T18:19:42.978 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:42.978 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj174 datafile 2020-02-08T18:19:43.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj175 datafile 2020-02-08T18:19:43.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj176 datafile 2020-02-08T18:19:43.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj177 datafile 2020-02-08T18:19:43.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj178 datafile 2020-02-08T18:19:43.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj179 datafile 2020-02-08T18:19:43.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj180 datafile 2020-02-08T18:19:43.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj181 datafile 2020-02-08T18:19:43.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj182 datafile 2020-02-08T18:19:43.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:43.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj183 datafile 2020-02-08T18:19:44.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj184 datafile 2020-02-08T18:19:44.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj185 datafile 2020-02-08T18:19:44.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj186 datafile 2020-02-08T18:19:44.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.359 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj187 datafile 2020-02-08T18:19:44.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj188 datafile 2020-02-08T18:19:44.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj189 datafile 2020-02-08T18:19:44.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj190 datafile 2020-02-08T18:19:44.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj191 datafile 2020-02-08T18:19:44.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj192 datafile 2020-02-08T18:19:44.726 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.726 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj193 datafile 2020-02-08T18:19:44.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj194 datafile 2020-02-08T18:19:44.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj195 datafile 2020-02-08T18:19:44.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj196 datafile 2020-02-08T18:19:44.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj197 datafile 2020-02-08T18:19:44.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:44.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj198 datafile 2020-02-08T18:19:45.030 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj199 datafile 2020-02-08T18:19:45.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj200 datafile 2020-02-08T18:19:45.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj201 datafile 2020-02-08T18:19:45.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj202 datafile 2020-02-08T18:19:45.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.306 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj203 datafile 2020-02-08T18:19:45.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj204 datafile 2020-02-08T18:19:45.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj205 datafile 2020-02-08T18:19:45.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj206 datafile 2020-02-08T18:19:45.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj207 datafile 2020-02-08T18:19:45.687 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.687 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj208 datafile 2020-02-08T18:19:45.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj209 datafile 2020-02-08T18:19:45.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj210 datafile 2020-02-08T18:19:45.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj211 datafile 2020-02-08T18:19:45.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:45.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj212 datafile 2020-02-08T18:19:46.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj213 datafile 2020-02-08T18:19:46.081 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.081 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj214 datafile 2020-02-08T18:19:46.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj215 datafile 2020-02-08T18:19:46.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj216 datafile 2020-02-08T18:19:46.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj217 datafile 2020-02-08T18:19:46.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj218 datafile 2020-02-08T18:19:46.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj219 datafile 2020-02-08T18:19:46.414 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.415 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj220 datafile 2020-02-08T18:19:46.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj221 datafile 2020-02-08T18:19:46.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj222 datafile 2020-02-08T18:19:46.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj223 datafile 2020-02-08T18:19:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.715 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj224 datafile 2020-02-08T18:19:46.799 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.799 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj225 datafile 2020-02-08T18:19:46.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj226 datafile 2020-02-08T18:19:46.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:46.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj227 datafile 2020-02-08T18:19:47.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj228 datafile 2020-02-08T18:19:47.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj229 datafile 2020-02-08T18:19:47.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj230 datafile 2020-02-08T18:19:47.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj231 datafile 2020-02-08T18:19:47.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj232 datafile 2020-02-08T18:19:47.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj233 datafile 2020-02-08T18:19:47.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj234 datafile 2020-02-08T18:19:47.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj235 datafile 2020-02-08T18:19:47.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj236 datafile 2020-02-08T18:19:47.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj237 datafile 2020-02-08T18:19:47.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj238 datafile 2020-02-08T18:19:47.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj239 datafile 2020-02-08T18:19:47.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj240 datafile 2020-02-08T18:19:47.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:47.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj241 datafile 2020-02-08T18:19:48.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj242 datafile 2020-02-08T18:19:48.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj243 datafile 2020-02-08T18:19:48.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj244 datafile 2020-02-08T18:19:48.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj245 datafile 2020-02-08T18:19:48.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj246 datafile 2020-02-08T18:19:48.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj247 datafile 2020-02-08T18:19:48.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj248 datafile 2020-02-08T18:19:48.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj249 datafile 2020-02-08T18:19:48.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj250 datafile 2020-02-08T18:19:48.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj251 datafile 2020-02-08T18:19:48.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj252 datafile 2020-02-08T18:19:48.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj253 datafile 2020-02-08T18:19:48.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj254 datafile 2020-02-08T18:19:48.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:48.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj255 datafile 2020-02-08T18:19:49.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj256 datafile 2020-02-08T18:19:49.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj257 datafile 2020-02-08T18:19:49.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj258 datafile 2020-02-08T18:19:49.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj259 datafile 2020-02-08T18:19:49.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj260 datafile 2020-02-08T18:19:49.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj261 datafile 2020-02-08T18:19:49.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj262 datafile 2020-02-08T18:19:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj263 datafile 2020-02-08T18:19:49.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj264 datafile 2020-02-08T18:19:49.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj265 datafile 2020-02-08T18:19:49.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj266 datafile 2020-02-08T18:19:49.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj267 datafile 2020-02-08T18:19:49.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj268 datafile 2020-02-08T18:19:49.857 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.857 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj269 datafile 2020-02-08T18:19:49.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:49.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj270 datafile 2020-02-08T18:19:50.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj271 datafile 2020-02-08T18:19:50.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj272 datafile 2020-02-08T18:19:50.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj273 datafile 2020-02-08T18:19:50.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj274 datafile 2020-02-08T18:19:50.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj275 datafile 2020-02-08T18:19:50.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj276 datafile 2020-02-08T18:19:50.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj277 datafile 2020-02-08T18:19:50.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj278 datafile 2020-02-08T18:19:50.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj279 datafile 2020-02-08T18:19:50.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj280 datafile 2020-02-08T18:19:50.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj281 datafile 2020-02-08T18:19:50.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj282 datafile 2020-02-08T18:19:50.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj283 datafile 2020-02-08T18:19:50.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.952 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj284 datafile 2020-02-08T18:19:50.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:50.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj285 datafile 2020-02-08T18:19:51.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj286 datafile 2020-02-08T18:19:51.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj287 datafile 2020-02-08T18:19:51.303 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.303 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj288 datafile 2020-02-08T18:19:51.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj289 datafile 2020-02-08T18:19:51.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj290 datafile 2020-02-08T18:19:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj291 datafile 2020-02-08T18:19:51.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.510 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj292 datafile 2020-02-08T18:19:51.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj293 datafile 2020-02-08T18:19:51.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj294 datafile 2020-02-08T18:19:51.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj295 datafile 2020-02-08T18:19:51.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj296 datafile 2020-02-08T18:19:51.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj297 datafile 2020-02-08T18:19:51.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj298 datafile 2020-02-08T18:19:51.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj299 datafile 2020-02-08T18:19:51.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:51.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj300 datafile 2020-02-08T18:19:52.021 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj301 datafile 2020-02-08T18:19:52.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj302 datafile 2020-02-08T18:19:52.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj303 datafile 2020-02-08T18:19:52.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj304 datafile 2020-02-08T18:19:52.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj305 datafile 2020-02-08T18:19:52.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj306 datafile 2020-02-08T18:19:52.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj307 datafile 2020-02-08T18:19:52.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj308 datafile 2020-02-08T18:19:52.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj309 datafile 2020-02-08T18:19:52.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj310 datafile 2020-02-08T18:19:52.740 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.740 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj311 datafile 2020-02-08T18:19:52.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj312 datafile 2020-02-08T18:19:52.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:52.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj313 datafile 2020-02-08T18:19:53.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj314 datafile 2020-02-08T18:19:53.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj315 datafile 2020-02-08T18:19:53.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj316 datafile 2020-02-08T18:19:53.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj317 datafile 2020-02-08T18:19:53.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj318 datafile 2020-02-08T18:19:53.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj319 datafile 2020-02-08T18:19:53.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj320 datafile 2020-02-08T18:19:53.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj321 datafile 2020-02-08T18:19:53.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj322 datafile 2020-02-08T18:19:53.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj323 datafile 2020-02-08T18:19:53.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj324 datafile 2020-02-08T18:19:53.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj325 datafile 2020-02-08T18:19:53.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj326 datafile 2020-02-08T18:19:53.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj327 datafile 2020-02-08T18:19:53.919 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:53.919 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj328 datafile 2020-02-08T18:19:54.019 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj329 datafile 2020-02-08T18:19:54.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj330 datafile 2020-02-08T18:19:54.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj331 datafile 2020-02-08T18:19:54.239 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj332 datafile 2020-02-08T18:19:54.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj333 datafile 2020-02-08T18:19:54.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.386 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj334 datafile 2020-02-08T18:19:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj335 datafile 2020-02-08T18:19:54.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj336 datafile 2020-02-08T18:19:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj337 datafile 2020-02-08T18:19:54.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj338 datafile 2020-02-08T18:19:54.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj339 datafile 2020-02-08T18:19:54.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj340 datafile 2020-02-08T18:19:54.872 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.872 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj341 datafile 2020-02-08T18:19:54.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj342 datafile 2020-02-08T18:19:54.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:54.966 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj343 datafile 2020-02-08T18:19:55.015 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.015 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj344 datafile 2020-02-08T18:19:55.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj345 datafile 2020-02-08T18:19:55.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj346 datafile 2020-02-08T18:19:55.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj347 datafile 2020-02-08T18:19:55.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj348 datafile 2020-02-08T18:19:55.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj349 datafile 2020-02-08T18:19:55.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj350 datafile 2020-02-08T18:19:55.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj351 datafile 2020-02-08T18:19:55.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj352 datafile 2020-02-08T18:19:55.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj353 datafile 2020-02-08T18:19:55.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj354 datafile 2020-02-08T18:19:55.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj355 datafile 2020-02-08T18:19:55.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj356 datafile 2020-02-08T18:19:55.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj357 datafile 2020-02-08T18:19:55.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:55.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj358 datafile 2020-02-08T18:19:56.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj359 datafile 2020-02-08T18:19:56.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj360 datafile 2020-02-08T18:19:56.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj361 datafile 2020-02-08T18:19:56.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj362 datafile 2020-02-08T18:19:56.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj363 datafile 2020-02-08T18:19:56.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj364 datafile 2020-02-08T18:19:56.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj365 datafile 2020-02-08T18:19:56.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj366 datafile 2020-02-08T18:19:56.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj367 datafile 2020-02-08T18:19:56.619 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.619 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj368 datafile 2020-02-08T18:19:56.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj369 datafile 2020-02-08T18:19:56.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj370 datafile 2020-02-08T18:19:56.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj371 datafile 2020-02-08T18:19:56.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj372 datafile 2020-02-08T18:19:56.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:56.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj373 datafile 2020-02-08T18:19:57.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj374 datafile 2020-02-08T18:19:57.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj375 datafile 2020-02-08T18:19:57.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj376 datafile 2020-02-08T18:19:57.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj377 datafile 2020-02-08T18:19:57.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj378 datafile 2020-02-08T18:19:57.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj379 datafile 2020-02-08T18:19:57.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj380 datafile 2020-02-08T18:19:57.408 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.408 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj381 datafile 2020-02-08T18:19:57.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj382 datafile 2020-02-08T18:19:57.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj383 datafile 2020-02-08T18:19:57.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj384 datafile 2020-02-08T18:19:57.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj385 datafile 2020-02-08T18:19:57.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj386 datafile 2020-02-08T18:19:57.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj387 datafile 2020-02-08T18:19:57.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj388 datafile 2020-02-08T18:19:57.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:57.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj389 datafile 2020-02-08T18:19:58.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj390 datafile 2020-02-08T18:19:58.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj391 datafile 2020-02-08T18:19:58.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj392 datafile 2020-02-08T18:19:58.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj393 datafile 2020-02-08T18:19:58.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj394 datafile 2020-02-08T18:19:58.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj395 datafile 2020-02-08T18:19:58.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj396 datafile 2020-02-08T18:19:58.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj397 datafile 2020-02-08T18:19:58.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj398 datafile 2020-02-08T18:19:58.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj399 datafile 2020-02-08T18:19:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj400 datafile 2020-02-08T18:19:58.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj401 datafile 2020-02-08T18:19:58.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj402 datafile 2020-02-08T18:19:58.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj403 datafile 2020-02-08T18:19:58.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj404 datafile 2020-02-08T18:19:58.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:58.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj405 datafile 2020-02-08T18:19:59.070 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.070 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj406 datafile 2020-02-08T18:19:59.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj407 datafile 2020-02-08T18:19:59.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.220 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj408 datafile 2020-02-08T18:19:59.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj409 datafile 2020-02-08T18:19:59.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj410 datafile 2020-02-08T18:19:59.376 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.377 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj411 datafile 2020-02-08T18:19:59.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj412 datafile 2020-02-08T18:19:59.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj413 datafile 2020-02-08T18:19:59.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj414 datafile 2020-02-08T18:19:59.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj415 datafile 2020-02-08T18:19:59.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj416 datafile 2020-02-08T18:19:59.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj417 datafile 2020-02-08T18:19:59.831 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.831 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj418 datafile 2020-02-08T18:19:59.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj419 datafile 2020-02-08T18:19:59.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:19:59.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj420 datafile 2020-02-08T18:20:00.036 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.036 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj421 datafile 2020-02-08T18:20:00.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj422 datafile 2020-02-08T18:20:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj423 datafile 2020-02-08T18:20:00.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj424 datafile 2020-02-08T18:20:00.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.238 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj425 datafile 2020-02-08T18:20:00.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj426 datafile 2020-02-08T18:20:00.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj427 datafile 2020-02-08T18:20:00.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj428 datafile 2020-02-08T18:20:00.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj429 datafile 2020-02-08T18:20:00.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj430 datafile 2020-02-08T18:20:00.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj431 datafile 2020-02-08T18:20:00.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj432 datafile 2020-02-08T18:20:00.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj433 datafile 2020-02-08T18:20:00.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj434 datafile 2020-02-08T18:20:00.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj435 datafile 2020-02-08T18:20:00.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:00.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj436 datafile 2020-02-08T18:20:01.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj437 datafile 2020-02-08T18:20:01.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj438 datafile 2020-02-08T18:20:01.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj439 datafile 2020-02-08T18:20:01.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj440 datafile 2020-02-08T18:20:01.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj441 datafile 2020-02-08T18:20:01.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj442 datafile 2020-02-08T18:20:01.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj443 datafile 2020-02-08T18:20:01.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj444 datafile 2020-02-08T18:20:01.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj445 datafile 2020-02-08T18:20:01.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj446 datafile 2020-02-08T18:20:01.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj447 datafile 2020-02-08T18:20:01.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj448 datafile 2020-02-08T18:20:01.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj449 datafile 2020-02-08T18:20:01.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:01.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj450 datafile 2020-02-08T18:20:02.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj451 datafile 2020-02-08T18:20:02.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj452 datafile 2020-02-08T18:20:02.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj453 datafile 2020-02-08T18:20:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj454 datafile 2020-02-08T18:20:02.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj455 datafile 2020-02-08T18:20:02.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj456 datafile 2020-02-08T18:20:02.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj457 datafile 2020-02-08T18:20:02.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj458 datafile 2020-02-08T18:20:02.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj459 datafile 2020-02-08T18:20:02.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj460 datafile 2020-02-08T18:20:02.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.726 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj461 datafile 2020-02-08T18:20:02.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj462 datafile 2020-02-08T18:20:02.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj463 datafile 2020-02-08T18:20:02.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:02.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj464 datafile 2020-02-08T18:20:03.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj465 datafile 2020-02-08T18:20:03.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj466 datafile 2020-02-08T18:20:03.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj467 datafile 2020-02-08T18:20:03.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj468 datafile 2020-02-08T18:20:03.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj469 datafile 2020-02-08T18:20:03.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj470 datafile 2020-02-08T18:20:03.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj471 datafile 2020-02-08T18:20:03.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj472 datafile 2020-02-08T18:20:03.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj473 datafile 2020-02-08T18:20:03.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj474 datafile 2020-02-08T18:20:03.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj475 datafile 2020-02-08T18:20:03.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj476 datafile 2020-02-08T18:20:03.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj477 datafile 2020-02-08T18:20:03.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj478 datafile 2020-02-08T18:20:03.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:03.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj479 datafile 2020-02-08T18:20:04.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj480 datafile 2020-02-08T18:20:04.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj481 datafile 2020-02-08T18:20:04.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj482 datafile 2020-02-08T18:20:04.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj483 datafile 2020-02-08T18:20:04.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj484 datafile 2020-02-08T18:20:04.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj485 datafile 2020-02-08T18:20:04.434 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.434 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj486 datafile 2020-02-08T18:20:04.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj487 datafile 2020-02-08T18:20:04.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj488 datafile 2020-02-08T18:20:04.555 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.555 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj489 datafile 2020-02-08T18:20:04.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj490 datafile 2020-02-08T18:20:04.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj491 datafile 2020-02-08T18:20:04.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj492 datafile 2020-02-08T18:20:04.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj493 datafile 2020-02-08T18:20:04.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj494 datafile 2020-02-08T18:20:04.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:04.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj495 datafile 2020-02-08T18:20:05.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj496 datafile 2020-02-08T18:20:05.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj497 datafile 2020-02-08T18:20:05.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj498 datafile 2020-02-08T18:20:05.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj499 datafile 2020-02-08T18:20:05.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj500 datafile 2020-02-08T18:20:05.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj501 datafile 2020-02-08T18:20:05.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj502 datafile 2020-02-08T18:20:05.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj503 datafile 2020-02-08T18:20:05.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj504 datafile 2020-02-08T18:20:05.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj505 datafile 2020-02-08T18:20:05.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj506 datafile 2020-02-08T18:20:05.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.612 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj507 datafile 2020-02-08T18:20:05.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj508 datafile 2020-02-08T18:20:05.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj509 datafile 2020-02-08T18:20:05.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj510 datafile 2020-02-08T18:20:05.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj511 datafile 2020-02-08T18:20:05.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:05.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj512 datafile 2020-02-08T18:20:06.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj513 datafile 2020-02-08T18:20:06.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj514 datafile 2020-02-08T18:20:06.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj515 datafile 2020-02-08T18:20:06.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj516 datafile 2020-02-08T18:20:06.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj517 datafile 2020-02-08T18:20:06.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj518 datafile 2020-02-08T18:20:06.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj519 datafile 2020-02-08T18:20:06.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj520 datafile 2020-02-08T18:20:06.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj521 datafile 2020-02-08T18:20:06.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj522 datafile 2020-02-08T18:20:06.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj523 datafile 2020-02-08T18:20:06.715 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj524 datafile 2020-02-08T18:20:06.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj525 datafile 2020-02-08T18:20:06.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj526 datafile 2020-02-08T18:20:06.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj527 datafile 2020-02-08T18:20:06.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:06.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj528 datafile 2020-02-08T18:20:07.049 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.049 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj529 datafile 2020-02-08T18:20:07.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj530 datafile 2020-02-08T18:20:07.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj531 datafile 2020-02-08T18:20:07.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj532 datafile 2020-02-08T18:20:07.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj533 datafile 2020-02-08T18:20:07.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj534 datafile 2020-02-08T18:20:07.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj535 datafile 2020-02-08T18:20:07.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj536 datafile 2020-02-08T18:20:07.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj537 datafile 2020-02-08T18:20:07.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.643 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj538 datafile 2020-02-08T18:20:07.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj539 datafile 2020-02-08T18:20:07.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj540 datafile 2020-02-08T18:20:07.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj541 datafile 2020-02-08T18:20:07.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj542 datafile 2020-02-08T18:20:07.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:07.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj543 datafile 2020-02-08T18:20:08.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj544 datafile 2020-02-08T18:20:08.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj545 datafile 2020-02-08T18:20:08.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj546 datafile 2020-02-08T18:20:08.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj547 datafile 2020-02-08T18:20:08.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj548 datafile 2020-02-08T18:20:08.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj549 datafile 2020-02-08T18:20:08.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj550 datafile 2020-02-08T18:20:08.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj551 datafile 2020-02-08T18:20:08.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.612 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj552 datafile 2020-02-08T18:20:08.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj553 datafile 2020-02-08T18:20:08.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj554 datafile 2020-02-08T18:20:08.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj555 datafile 2020-02-08T18:20:08.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj556 datafile 2020-02-08T18:20:08.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj557 datafile 2020-02-08T18:20:08.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj558 datafile 2020-02-08T18:20:08.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:08.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj559 datafile 2020-02-08T18:20:09.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.030 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj560 datafile 2020-02-08T18:20:09.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj561 datafile 2020-02-08T18:20:09.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj562 datafile 2020-02-08T18:20:09.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj563 datafile 2020-02-08T18:20:09.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj564 datafile 2020-02-08T18:20:09.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj565 datafile 2020-02-08T18:20:09.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj566 datafile 2020-02-08T18:20:09.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj567 datafile 2020-02-08T18:20:09.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj568 datafile 2020-02-08T18:20:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj569 datafile 2020-02-08T18:20:09.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj570 datafile 2020-02-08T18:20:09.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj571 datafile 2020-02-08T18:20:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj572 datafile 2020-02-08T18:20:09.835 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj573 datafile 2020-02-08T18:20:09.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj574 datafile 2020-02-08T18:20:09.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:09.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj575 datafile 2020-02-08T18:20:10.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj576 datafile 2020-02-08T18:20:10.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj577 datafile 2020-02-08T18:20:10.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj578 datafile 2020-02-08T18:20:10.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj579 datafile 2020-02-08T18:20:10.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj580 datafile 2020-02-08T18:20:10.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj581 datafile 2020-02-08T18:20:10.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj582 datafile 2020-02-08T18:20:10.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj583 datafile 2020-02-08T18:20:10.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj584 datafile 2020-02-08T18:20:10.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.576 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj585 datafile 2020-02-08T18:20:10.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj586 datafile 2020-02-08T18:20:10.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj587 datafile 2020-02-08T18:20:10.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj588 datafile 2020-02-08T18:20:10.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:10.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj589 datafile 2020-02-08T18:20:11.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj590 datafile 2020-02-08T18:20:11.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj591 datafile 2020-02-08T18:20:11.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj592 datafile 2020-02-08T18:20:11.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj593 datafile 2020-02-08T18:20:11.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj594 datafile 2020-02-08T18:20:11.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj595 datafile 2020-02-08T18:20:11.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj596 datafile 2020-02-08T18:20:11.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj597 datafile 2020-02-08T18:20:11.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj598 datafile 2020-02-08T18:20:11.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj599 datafile 2020-02-08T18:20:11.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj600 datafile 2020-02-08T18:20:11.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj601 datafile 2020-02-08T18:20:11.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj602 datafile 2020-02-08T18:20:11.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj603 datafile 2020-02-08T18:20:11.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:11.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj604 datafile 2020-02-08T18:20:12.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj605 datafile 2020-02-08T18:20:12.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj606 datafile 2020-02-08T18:20:12.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj607 datafile 2020-02-08T18:20:12.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj608 datafile 2020-02-08T18:20:12.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj609 datafile 2020-02-08T18:20:12.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj610 datafile 2020-02-08T18:20:12.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj611 datafile 2020-02-08T18:20:12.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj612 datafile 2020-02-08T18:20:12.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.543 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj613 datafile 2020-02-08T18:20:12.697 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj614 datafile 2020-02-08T18:20:12.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj615 datafile 2020-02-08T18:20:12.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj616 datafile 2020-02-08T18:20:12.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj617 datafile 2020-02-08T18:20:12.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:12.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj618 datafile 2020-02-08T18:20:13.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj619 datafile 2020-02-08T18:20:13.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj620 datafile 2020-02-08T18:20:13.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj621 datafile 2020-02-08T18:20:13.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj622 datafile 2020-02-08T18:20:13.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj623 datafile 2020-02-08T18:20:13.415 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj624 datafile 2020-02-08T18:20:13.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj625 datafile 2020-02-08T18:20:13.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj626 datafile 2020-02-08T18:20:13.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj627 datafile 2020-02-08T18:20:13.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj628 datafile 2020-02-08T18:20:13.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj629 datafile 2020-02-08T18:20:13.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj630 datafile 2020-02-08T18:20:13.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj631 datafile 2020-02-08T18:20:13.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:13.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj632 datafile 2020-02-08T18:20:14.067 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj633 datafile 2020-02-08T18:20:14.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj634 datafile 2020-02-08T18:20:14.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj635 datafile 2020-02-08T18:20:14.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj636 datafile 2020-02-08T18:20:14.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj637 datafile 2020-02-08T18:20:14.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj638 datafile 2020-02-08T18:20:14.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj639 datafile 2020-02-08T18:20:14.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj640 datafile 2020-02-08T18:20:14.543 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:14.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj641 datafile 2020-02-08T18:20:15.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj642 datafile 2020-02-08T18:20:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj643 datafile 2020-02-08T18:20:15.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj644 datafile 2020-02-08T18:20:15.561 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj645 datafile 2020-02-08T18:20:15.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj646 datafile 2020-02-08T18:20:15.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj647 datafile 2020-02-08T18:20:15.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj648 datafile 2020-02-08T18:20:15.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj649 datafile 2020-02-08T18:20:15.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:15.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj650 datafile 2020-02-08T18:20:16.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj651 datafile 2020-02-08T18:20:16.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj652 datafile 2020-02-08T18:20:16.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj653 datafile 2020-02-08T18:20:16.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj654 datafile 2020-02-08T18:20:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj655 datafile 2020-02-08T18:20:16.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj656 datafile 2020-02-08T18:20:16.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj657 datafile 2020-02-08T18:20:16.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj658 datafile 2020-02-08T18:20:16.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj659 datafile 2020-02-08T18:20:16.555 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj660 datafile 2020-02-08T18:20:16.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj661 datafile 2020-02-08T18:20:16.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj662 datafile 2020-02-08T18:20:16.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj663 datafile 2020-02-08T18:20:16.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:16.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj664 datafile 2020-02-08T18:20:17.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj665 datafile 2020-02-08T18:20:17.065 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj666 datafile 2020-02-08T18:20:17.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj667 datafile 2020-02-08T18:20:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj668 datafile 2020-02-08T18:20:17.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj669 datafile 2020-02-08T18:20:17.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj670 datafile 2020-02-08T18:20:17.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj671 datafile 2020-02-08T18:20:17.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.434 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj672 datafile 2020-02-08T18:20:17.479 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.479 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj673 datafile 2020-02-08T18:20:17.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj674 datafile 2020-02-08T18:20:17.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj675 datafile 2020-02-08T18:20:17.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj676 datafile 2020-02-08T18:20:17.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj677 datafile 2020-02-08T18:20:17.834 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.834 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj678 datafile 2020-02-08T18:20:17.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj679 datafile 2020-02-08T18:20:17.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj680 datafile 2020-02-08T18:20:17.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:17.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj681 datafile 2020-02-08T18:20:18.053 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj682 datafile 2020-02-08T18:20:18.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj683 datafile 2020-02-08T18:20:18.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj684 datafile 2020-02-08T18:20:18.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj685 datafile 2020-02-08T18:20:18.377 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.377 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj686 datafile 2020-02-08T18:20:18.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj687 datafile 2020-02-08T18:20:18.479 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.479 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj688 datafile 2020-02-08T18:20:18.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj689 datafile 2020-02-08T18:20:18.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj690 datafile 2020-02-08T18:20:18.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj691 datafile 2020-02-08T18:20:18.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj692 datafile 2020-02-08T18:20:18.822 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.822 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj693 datafile 2020-02-08T18:20:18.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:18.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj694 datafile 2020-02-08T18:20:19.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj695 datafile 2020-02-08T18:20:19.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj696 datafile 2020-02-08T18:20:19.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj697 datafile 2020-02-08T18:20:19.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj698 datafile 2020-02-08T18:20:19.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj699 datafile 2020-02-08T18:20:19.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj700 datafile 2020-02-08T18:20:19.414 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.414 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj701 datafile 2020-02-08T18:20:19.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj702 datafile 2020-02-08T18:20:19.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj703 datafile 2020-02-08T18:20:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj704 datafile 2020-02-08T18:20:19.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj705 datafile 2020-02-08T18:20:19.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj706 datafile 2020-02-08T18:20:19.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj707 datafile 2020-02-08T18:20:19.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj708 datafile 2020-02-08T18:20:19.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:19.957 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj709 datafile 2020-02-08T18:20:20.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj710 datafile 2020-02-08T18:20:20.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj711 datafile 2020-02-08T18:20:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj712 datafile 2020-02-08T18:20:20.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj713 datafile 2020-02-08T18:20:20.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj714 datafile 2020-02-08T18:20:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj715 datafile 2020-02-08T18:20:20.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj716 datafile 2020-02-08T18:20:20.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj717 datafile 2020-02-08T18:20:20.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj718 datafile 2020-02-08T18:20:20.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj719 datafile 2020-02-08T18:20:20.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj720 datafile 2020-02-08T18:20:20.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj721 datafile 2020-02-08T18:20:20.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj722 datafile 2020-02-08T18:20:20.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:20.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj723 datafile 2020-02-08T18:20:21.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj724 datafile 2020-02-08T18:20:21.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj725 datafile 2020-02-08T18:20:21.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj726 datafile 2020-02-08T18:20:21.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj727 datafile 2020-02-08T18:20:21.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj728 datafile 2020-02-08T18:20:21.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj729 datafile 2020-02-08T18:20:21.464 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.465 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj730 datafile 2020-02-08T18:20:21.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj731 datafile 2020-02-08T18:20:21.548 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.548 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj732 datafile 2020-02-08T18:20:21.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj733 datafile 2020-02-08T18:20:21.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj734 datafile 2020-02-08T18:20:21.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj735 datafile 2020-02-08T18:20:21.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj736 datafile 2020-02-08T18:20:21.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj737 datafile 2020-02-08T18:20:21.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:21.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj738 datafile 2020-02-08T18:20:22.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj739 datafile 2020-02-08T18:20:22.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj740 datafile 2020-02-08T18:20:22.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj741 datafile 2020-02-08T18:20:22.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj742 datafile 2020-02-08T18:20:22.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj743 datafile 2020-02-08T18:20:22.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj744 datafile 2020-02-08T18:20:22.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj745 datafile 2020-02-08T18:20:22.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj746 datafile 2020-02-08T18:20:22.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj747 datafile 2020-02-08T18:20:22.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj748 datafile 2020-02-08T18:20:22.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj749 datafile 2020-02-08T18:20:22.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj750 datafile 2020-02-08T18:20:22.972 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:22.972 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj751 datafile 2020-02-08T18:20:23.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.058 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj752 datafile 2020-02-08T18:20:23.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj753 datafile 2020-02-08T18:20:23.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj754 datafile 2020-02-08T18:20:23.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.251 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj755 datafile 2020-02-08T18:20:23.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj756 datafile 2020-02-08T18:20:23.399 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.399 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj757 datafile 2020-02-08T18:20:23.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj758 datafile 2020-02-08T18:20:23.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj759 datafile 2020-02-08T18:20:23.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj760 datafile 2020-02-08T18:20:23.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj761 datafile 2020-02-08T18:20:23.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj762 datafile 2020-02-08T18:20:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj763 datafile 2020-02-08T18:20:23.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj764 datafile 2020-02-08T18:20:23.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:23.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj765 datafile 2020-02-08T18:20:24.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj766 datafile 2020-02-08T18:20:24.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.074 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj767 datafile 2020-02-08T18:20:24.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj768 datafile 2020-02-08T18:20:24.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj769 datafile 2020-02-08T18:20:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj770 datafile 2020-02-08T18:20:24.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj771 datafile 2020-02-08T18:20:24.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj772 datafile 2020-02-08T18:20:24.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj773 datafile 2020-02-08T18:20:24.548 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj774 datafile 2020-02-08T18:20:24.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj775 datafile 2020-02-08T18:20:24.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj776 datafile 2020-02-08T18:20:24.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj777 datafile 2020-02-08T18:20:24.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj778 datafile 2020-02-08T18:20:24.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj779 datafile 2020-02-08T18:20:24.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:24.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj780 datafile 2020-02-08T18:20:25.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj781 datafile 2020-02-08T18:20:25.071 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj782 datafile 2020-02-08T18:20:25.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj783 datafile 2020-02-08T18:20:25.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj784 datafile 2020-02-08T18:20:25.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj785 datafile 2020-02-08T18:20:25.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj786 datafile 2020-02-08T18:20:25.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj787 datafile 2020-02-08T18:20:25.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj788 datafile 2020-02-08T18:20:25.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj789 datafile 2020-02-08T18:20:25.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj790 datafile 2020-02-08T18:20:25.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj791 datafile 2020-02-08T18:20:25.772 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.772 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj792 datafile 2020-02-08T18:20:25.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:25.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj793 datafile 2020-02-08T18:20:26.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj794 datafile 2020-02-08T18:20:26.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj795 datafile 2020-02-08T18:20:26.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj796 datafile 2020-02-08T18:20:26.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj797 datafile 2020-02-08T18:20:26.306 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.306 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj798 datafile 2020-02-08T18:20:26.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj799 datafile 2020-02-08T18:20:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj800 datafile 2020-02-08T18:20:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.547 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj801 datafile 2020-02-08T18:20:26.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj802 datafile 2020-02-08T18:20:26.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj803 datafile 2020-02-08T18:20:26.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj804 datafile 2020-02-08T18:20:26.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj805 datafile 2020-02-08T18:20:26.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj806 datafile 2020-02-08T18:20:26.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:26.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj807 datafile 2020-02-08T18:20:27.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj808 datafile 2020-02-08T18:20:27.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj809 datafile 2020-02-08T18:20:27.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.185 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj810 datafile 2020-02-08T18:20:27.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj811 datafile 2020-02-08T18:20:27.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj812 datafile 2020-02-08T18:20:27.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj813 datafile 2020-02-08T18:20:27.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj814 datafile 2020-02-08T18:20:27.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj815 datafile 2020-02-08T18:20:27.579 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.579 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj816 datafile 2020-02-08T18:20:27.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj817 datafile 2020-02-08T18:20:27.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj818 datafile 2020-02-08T18:20:27.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj819 datafile 2020-02-08T18:20:27.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj820 datafile 2020-02-08T18:20:27.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj821 datafile 2020-02-08T18:20:27.933 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:27.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj822 datafile 2020-02-08T18:20:28.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj823 datafile 2020-02-08T18:20:28.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj824 datafile 2020-02-08T18:20:28.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj825 datafile 2020-02-08T18:20:28.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj826 datafile 2020-02-08T18:20:28.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj827 datafile 2020-02-08T18:20:28.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj828 datafile 2020-02-08T18:20:28.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.447 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj829 datafile 2020-02-08T18:20:28.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj830 datafile 2020-02-08T18:20:28.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj831 datafile 2020-02-08T18:20:28.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj832 datafile 2020-02-08T18:20:28.764 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj833 datafile 2020-02-08T18:20:28.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj834 datafile 2020-02-08T18:20:28.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj835 datafile 2020-02-08T18:20:28.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj836 datafile 2020-02-08T18:20:28.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:28.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj837 datafile 2020-02-08T18:20:29.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj838 datafile 2020-02-08T18:20:29.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj839 datafile 2020-02-08T18:20:29.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj840 datafile 2020-02-08T18:20:29.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj841 datafile 2020-02-08T18:20:29.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj842 datafile 2020-02-08T18:20:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj843 datafile 2020-02-08T18:20:29.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj844 datafile 2020-02-08T18:20:29.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj845 datafile 2020-02-08T18:20:29.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj846 datafile 2020-02-08T18:20:29.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj847 datafile 2020-02-08T18:20:29.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj848 datafile 2020-02-08T18:20:29.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj849 datafile 2020-02-08T18:20:29.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj850 datafile 2020-02-08T18:20:29.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:29.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj851 datafile 2020-02-08T18:20:30.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj852 datafile 2020-02-08T18:20:30.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj853 datafile 2020-02-08T18:20:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj854 datafile 2020-02-08T18:20:30.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj855 datafile 2020-02-08T18:20:30.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj856 datafile 2020-02-08T18:20:30.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj857 datafile 2020-02-08T18:20:30.468 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.469 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj858 datafile 2020-02-08T18:20:30.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj859 datafile 2020-02-08T18:20:30.644 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.644 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj860 datafile 2020-02-08T18:20:30.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj861 datafile 2020-02-08T18:20:30.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj862 datafile 2020-02-08T18:20:30.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj863 datafile 2020-02-08T18:20:30.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj864 datafile 2020-02-08T18:20:30.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:30.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj865 datafile 2020-02-08T18:20:31.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj866 datafile 2020-02-08T18:20:31.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj867 datafile 2020-02-08T18:20:31.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj868 datafile 2020-02-08T18:20:31.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj869 datafile 2020-02-08T18:20:31.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj870 datafile 2020-02-08T18:20:31.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj871 datafile 2020-02-08T18:20:31.526 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.526 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj872 datafile 2020-02-08T18:20:31.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj873 datafile 2020-02-08T18:20:31.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj874 datafile 2020-02-08T18:20:31.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj875 datafile 2020-02-08T18:20:31.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj876 datafile 2020-02-08T18:20:31.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj877 datafile 2020-02-08T18:20:31.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:31.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj878 datafile 2020-02-08T18:20:32.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj879 datafile 2020-02-08T18:20:32.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj880 datafile 2020-02-08T18:20:32.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj881 datafile 2020-02-08T18:20:32.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj882 datafile 2020-02-08T18:20:32.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj883 datafile 2020-02-08T18:20:32.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj884 datafile 2020-02-08T18:20:32.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj885 datafile 2020-02-08T18:20:32.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj886 datafile 2020-02-08T18:20:32.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj887 datafile 2020-02-08T18:20:32.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj888 datafile 2020-02-08T18:20:32.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj889 datafile 2020-02-08T18:20:32.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj890 datafile 2020-02-08T18:20:32.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj891 datafile 2020-02-08T18:20:32.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:32.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj892 datafile 2020-02-08T18:20:33.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.027 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj893 datafile 2020-02-08T18:20:33.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj894 datafile 2020-02-08T18:20:33.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj895 datafile 2020-02-08T18:20:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj896 datafile 2020-02-08T18:20:33.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj897 datafile 2020-02-08T18:20:33.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj898 datafile 2020-02-08T18:20:33.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj899 datafile 2020-02-08T18:20:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj900 datafile 2020-02-08T18:20:33.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj901 datafile 2020-02-08T18:20:33.607 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.607 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj902 datafile 2020-02-08T18:20:33.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj903 datafile 2020-02-08T18:20:33.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj904 datafile 2020-02-08T18:20:33.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj905 datafile 2020-02-08T18:20:33.835 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj906 datafile 2020-02-08T18:20:33.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj907 datafile 2020-02-08T18:20:33.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:33.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj908 datafile 2020-02-08T18:20:34.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.112 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj909 datafile 2020-02-08T18:20:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj910 datafile 2020-02-08T18:20:34.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj911 datafile 2020-02-08T18:20:34.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj912 datafile 2020-02-08T18:20:34.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj913 datafile 2020-02-08T18:20:34.404 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.404 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj914 datafile 2020-02-08T18:20:34.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj915 datafile 2020-02-08T18:20:34.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj916 datafile 2020-02-08T18:20:34.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj917 datafile 2020-02-08T18:20:34.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj918 datafile 2020-02-08T18:20:34.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj919 datafile 2020-02-08T18:20:34.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj920 datafile 2020-02-08T18:20:34.989 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:34.989 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj921 datafile 2020-02-08T18:20:35.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj922 datafile 2020-02-08T18:20:35.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj923 datafile 2020-02-08T18:20:35.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj924 datafile 2020-02-08T18:20:35.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj925 datafile 2020-02-08T18:20:35.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj926 datafile 2020-02-08T18:20:35.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj927 datafile 2020-02-08T18:20:35.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj928 datafile 2020-02-08T18:20:35.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj929 datafile 2020-02-08T18:20:35.548 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.548 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj930 datafile 2020-02-08T18:20:35.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj931 datafile 2020-02-08T18:20:35.682 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj932 datafile 2020-02-08T18:20:35.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj933 datafile 2020-02-08T18:20:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj934 datafile 2020-02-08T18:20:35.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj935 datafile 2020-02-08T18:20:35.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:35.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj936 datafile 2020-02-08T18:20:36.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj937 datafile 2020-02-08T18:20:36.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj938 datafile 2020-02-08T18:20:36.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj939 datafile 2020-02-08T18:20:36.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj940 datafile 2020-02-08T18:20:36.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj941 datafile 2020-02-08T18:20:36.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj942 datafile 2020-02-08T18:20:36.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj943 datafile 2020-02-08T18:20:36.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj944 datafile 2020-02-08T18:20:36.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj945 datafile 2020-02-08T18:20:36.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj946 datafile 2020-02-08T18:20:36.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj947 datafile 2020-02-08T18:20:36.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj948 datafile 2020-02-08T18:20:36.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj949 datafile 2020-02-08T18:20:36.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj950 datafile 2020-02-08T18:20:36.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:36.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj951 datafile 2020-02-08T18:20:37.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj952 datafile 2020-02-08T18:20:37.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj953 datafile 2020-02-08T18:20:37.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj954 datafile 2020-02-08T18:20:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj955 datafile 2020-02-08T18:20:37.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj956 datafile 2020-02-08T18:20:37.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj957 datafile 2020-02-08T18:20:37.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj958 datafile 2020-02-08T18:20:37.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj959 datafile 2020-02-08T18:20:37.604 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.605 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj960 datafile 2020-02-08T18:20:37.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj961 datafile 2020-02-08T18:20:37.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj962 datafile 2020-02-08T18:20:37.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.828 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj963 datafile 2020-02-08T18:20:37.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:37.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj964 datafile 2020-02-08T18:20:38.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj965 datafile 2020-02-08T18:20:38.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj966 datafile 2020-02-08T18:20:38.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj967 datafile 2020-02-08T18:20:38.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj968 datafile 2020-02-08T18:20:38.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj969 datafile 2020-02-08T18:20:38.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj970 datafile 2020-02-08T18:20:38.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj971 datafile 2020-02-08T18:20:38.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj972 datafile 2020-02-08T18:20:38.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj973 datafile 2020-02-08T18:20:38.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj974 datafile 2020-02-08T18:20:38.682 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj975 datafile 2020-02-08T18:20:38.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj976 datafile 2020-02-08T18:20:38.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj977 datafile 2020-02-08T18:20:38.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj978 datafile 2020-02-08T18:20:38.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:38.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj979 datafile 2020-02-08T18:20:39.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj980 datafile 2020-02-08T18:20:39.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj981 datafile 2020-02-08T18:20:39.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj982 datafile 2020-02-08T18:20:39.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj983 datafile 2020-02-08T18:20:39.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj984 datafile 2020-02-08T18:20:39.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj985 datafile 2020-02-08T18:20:39.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj986 datafile 2020-02-08T18:20:39.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj987 datafile 2020-02-08T18:20:39.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj988 datafile 2020-02-08T18:20:39.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj989 datafile 2020-02-08T18:20:39.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj990 datafile 2020-02-08T18:20:39.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj991 datafile 2020-02-08T18:20:39.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj992 datafile 2020-02-08T18:20:39.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:39.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj993 datafile 2020-02-08T18:20:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj994 datafile 2020-02-08T18:20:40.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.070 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj995 datafile 2020-02-08T18:20:40.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj996 datafile 2020-02-08T18:20:40.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj997 datafile 2020-02-08T18:20:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj998 datafile 2020-02-08T18:20:40.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj999 datafile 2020-02-08T18:20:40.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test1 put obj1000 datafile 2020-02-08T18:20:40.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:72: TEST_recover_unexpected: for i in $(seq 1 $POOLS) 2020-02-08T18:20:40.404 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: seq 1 1000 2020-02-08T18:20:40.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj1 datafile 2020-02-08T18:20:40.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj2 datafile 2020-02-08T18:20:40.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj3 datafile 2020-02-08T18:20:40.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj4 datafile 2020-02-08T18:20:40.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj5 datafile 2020-02-08T18:20:40.833 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.833 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj6 datafile 2020-02-08T18:20:40.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj7 datafile 2020-02-08T18:20:40.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj8 datafile 2020-02-08T18:20:40.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:40.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj9 datafile 2020-02-08T18:20:41.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj10 datafile 2020-02-08T18:20:41.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj11 datafile 2020-02-08T18:20:41.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj12 datafile 2020-02-08T18:20:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj13 datafile 2020-02-08T18:20:41.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj14 datafile 2020-02-08T18:20:41.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj15 datafile 2020-02-08T18:20:41.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj16 datafile 2020-02-08T18:20:41.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj17 datafile 2020-02-08T18:20:41.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj18 datafile 2020-02-08T18:20:41.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.779 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj19 datafile 2020-02-08T18:20:41.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.859 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj20 datafile 2020-02-08T18:20:41.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:41.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj21 datafile 2020-02-08T18:20:42.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj22 datafile 2020-02-08T18:20:42.050 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.050 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj23 datafile 2020-02-08T18:20:42.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj24 datafile 2020-02-08T18:20:42.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj25 datafile 2020-02-08T18:20:42.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj26 datafile 2020-02-08T18:20:42.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj27 datafile 2020-02-08T18:20:42.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj28 datafile 2020-02-08T18:20:42.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj29 datafile 2020-02-08T18:20:42.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj30 datafile 2020-02-08T18:20:42.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj31 datafile 2020-02-08T18:20:42.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj32 datafile 2020-02-08T18:20:42.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj33 datafile 2020-02-08T18:20:42.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj34 datafile 2020-02-08T18:20:42.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:42.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj35 datafile 2020-02-08T18:20:43.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj36 datafile 2020-02-08T18:20:43.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj37 datafile 2020-02-08T18:20:43.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj38 datafile 2020-02-08T18:20:43.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj39 datafile 2020-02-08T18:20:43.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj40 datafile 2020-02-08T18:20:43.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj41 datafile 2020-02-08T18:20:43.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj42 datafile 2020-02-08T18:20:43.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj43 datafile 2020-02-08T18:20:43.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj44 datafile 2020-02-08T18:20:43.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj45 datafile 2020-02-08T18:20:43.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj46 datafile 2020-02-08T18:20:43.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj47 datafile 2020-02-08T18:20:43.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj48 datafile 2020-02-08T18:20:43.834 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.834 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj49 datafile 2020-02-08T18:20:43.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj50 datafile 2020-02-08T18:20:43.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:43.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj51 datafile 2020-02-08T18:20:44.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj52 datafile 2020-02-08T18:20:44.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj53 datafile 2020-02-08T18:20:44.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj54 datafile 2020-02-08T18:20:44.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj55 datafile 2020-02-08T18:20:44.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj56 datafile 2020-02-08T18:20:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj57 datafile 2020-02-08T18:20:44.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj58 datafile 2020-02-08T18:20:44.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj59 datafile 2020-02-08T18:20:44.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj60 datafile 2020-02-08T18:20:44.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj61 datafile 2020-02-08T18:20:44.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj62 datafile 2020-02-08T18:20:44.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj63 datafile 2020-02-08T18:20:44.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:44.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj64 datafile 2020-02-08T18:20:45.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj65 datafile 2020-02-08T18:20:45.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj66 datafile 2020-02-08T18:20:45.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj67 datafile 2020-02-08T18:20:45.234 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj68 datafile 2020-02-08T18:20:45.306 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.306 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj69 datafile 2020-02-08T18:20:45.401 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj70 datafile 2020-02-08T18:20:45.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj71 datafile 2020-02-08T18:20:45.543 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj72 datafile 2020-02-08T18:20:45.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj73 datafile 2020-02-08T18:20:45.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj74 datafile 2020-02-08T18:20:45.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj75 datafile 2020-02-08T18:20:45.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj76 datafile 2020-02-08T18:20:45.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj77 datafile 2020-02-08T18:20:45.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:45.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj78 datafile 2020-02-08T18:20:46.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:46.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj79 datafile 2020-02-08T18:20:46.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:46.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj80 datafile 2020-02-08T18:20:46.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:46.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj81 datafile 2020-02-08T18:20:46.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:46.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj82 datafile 2020-02-08T18:20:46.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:46.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj83 datafile 2020-02-08T18:20:47.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj84 datafile 2020-02-08T18:20:47.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj85 datafile 2020-02-08T18:20:47.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj86 datafile 2020-02-08T18:20:47.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj87 datafile 2020-02-08T18:20:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj88 datafile 2020-02-08T18:20:47.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj89 datafile 2020-02-08T18:20:47.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj90 datafile 2020-02-08T18:20:47.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj91 datafile 2020-02-08T18:20:47.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj92 datafile 2020-02-08T18:20:47.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj93 datafile 2020-02-08T18:20:47.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj94 datafile 2020-02-08T18:20:47.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj95 datafile 2020-02-08T18:20:47.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj96 datafile 2020-02-08T18:20:47.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj97 datafile 2020-02-08T18:20:47.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj98 datafile 2020-02-08T18:20:47.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:47.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj99 datafile 2020-02-08T18:20:48.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj100 datafile 2020-02-08T18:20:48.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj101 datafile 2020-02-08T18:20:48.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj102 datafile 2020-02-08T18:20:48.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj103 datafile 2020-02-08T18:20:48.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj104 datafile 2020-02-08T18:20:48.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj105 datafile 2020-02-08T18:20:48.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj106 datafile 2020-02-08T18:20:48.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj107 datafile 2020-02-08T18:20:48.663 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.663 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj108 datafile 2020-02-08T18:20:48.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj109 datafile 2020-02-08T18:20:48.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj110 datafile 2020-02-08T18:20:48.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj111 datafile 2020-02-08T18:20:48.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj112 datafile 2020-02-08T18:20:48.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:48.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj113 datafile 2020-02-08T18:20:49.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj114 datafile 2020-02-08T18:20:49.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj115 datafile 2020-02-08T18:20:49.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj116 datafile 2020-02-08T18:20:49.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj117 datafile 2020-02-08T18:20:49.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj118 datafile 2020-02-08T18:20:49.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj119 datafile 2020-02-08T18:20:49.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj120 datafile 2020-02-08T18:20:49.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj121 datafile 2020-02-08T18:20:49.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj122 datafile 2020-02-08T18:20:49.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj123 datafile 2020-02-08T18:20:49.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj124 datafile 2020-02-08T18:20:49.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj125 datafile 2020-02-08T18:20:49.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj126 datafile 2020-02-08T18:20:49.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj127 datafile 2020-02-08T18:20:49.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:49.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj128 datafile 2020-02-08T18:20:50.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.021 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj129 datafile 2020-02-08T18:20:50.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj130 datafile 2020-02-08T18:20:50.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj131 datafile 2020-02-08T18:20:50.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj132 datafile 2020-02-08T18:20:50.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj133 datafile 2020-02-08T18:20:50.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj134 datafile 2020-02-08T18:20:50.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj135 datafile 2020-02-08T18:20:50.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj136 datafile 2020-02-08T18:20:50.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj137 datafile 2020-02-08T18:20:50.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj138 datafile 2020-02-08T18:20:50.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj139 datafile 2020-02-08T18:20:50.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj140 datafile 2020-02-08T18:20:50.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:50.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj141 datafile 2020-02-08T18:20:51.027 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj142 datafile 2020-02-08T18:20:51.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj143 datafile 2020-02-08T18:20:51.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj144 datafile 2020-02-08T18:20:51.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj145 datafile 2020-02-08T18:20:51.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj146 datafile 2020-02-08T18:20:51.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj147 datafile 2020-02-08T18:20:51.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj148 datafile 2020-02-08T18:20:51.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj149 datafile 2020-02-08T18:20:51.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj150 datafile 2020-02-08T18:20:51.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj151 datafile 2020-02-08T18:20:51.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.793 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj152 datafile 2020-02-08T18:20:51.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj153 datafile 2020-02-08T18:20:51.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj154 datafile 2020-02-08T18:20:51.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj155 datafile 2020-02-08T18:20:51.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:51.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj156 datafile 2020-02-08T18:20:52.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj157 datafile 2020-02-08T18:20:52.160 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.160 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj158 datafile 2020-02-08T18:20:52.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj159 datafile 2020-02-08T18:20:52.251 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.251 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj160 datafile 2020-02-08T18:20:52.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj161 datafile 2020-02-08T18:20:52.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj162 datafile 2020-02-08T18:20:52.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj163 datafile 2020-02-08T18:20:52.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj164 datafile 2020-02-08T18:20:52.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj165 datafile 2020-02-08T18:20:52.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj166 datafile 2020-02-08T18:20:52.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj167 datafile 2020-02-08T18:20:52.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj168 datafile 2020-02-08T18:20:52.955 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.955 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj169 datafile 2020-02-08T18:20:52.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:52.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj170 datafile 2020-02-08T18:20:53.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj171 datafile 2020-02-08T18:20:53.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj172 datafile 2020-02-08T18:20:53.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj173 datafile 2020-02-08T18:20:53.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj174 datafile 2020-02-08T18:20:53.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj175 datafile 2020-02-08T18:20:53.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj176 datafile 2020-02-08T18:20:53.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj177 datafile 2020-02-08T18:20:53.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj178 datafile 2020-02-08T18:20:53.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj179 datafile 2020-02-08T18:20:53.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj180 datafile 2020-02-08T18:20:53.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj181 datafile 2020-02-08T18:20:53.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj182 datafile 2020-02-08T18:20:53.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:53.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj183 datafile 2020-02-08T18:20:54.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj184 datafile 2020-02-08T18:20:54.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj185 datafile 2020-02-08T18:20:54.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj186 datafile 2020-02-08T18:20:54.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj187 datafile 2020-02-08T18:20:54.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj188 datafile 2020-02-08T18:20:54.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj189 datafile 2020-02-08T18:20:54.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj190 datafile 2020-02-08T18:20:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj191 datafile 2020-02-08T18:20:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj192 datafile 2020-02-08T18:20:54.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj193 datafile 2020-02-08T18:20:54.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj194 datafile 2020-02-08T18:20:54.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj195 datafile 2020-02-08T18:20:54.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj196 datafile 2020-02-08T18:20:54.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:54.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj197 datafile 2020-02-08T18:20:55.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj198 datafile 2020-02-08T18:20:55.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj199 datafile 2020-02-08T18:20:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj200 datafile 2020-02-08T18:20:55.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj201 datafile 2020-02-08T18:20:55.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj202 datafile 2020-02-08T18:20:55.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj203 datafile 2020-02-08T18:20:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj204 datafile 2020-02-08T18:20:55.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj205 datafile 2020-02-08T18:20:55.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj206 datafile 2020-02-08T18:20:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj207 datafile 2020-02-08T18:20:55.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj208 datafile 2020-02-08T18:20:55.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj209 datafile 2020-02-08T18:20:55.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj210 datafile 2020-02-08T18:20:55.828 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj211 datafile 2020-02-08T18:20:55.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj212 datafile 2020-02-08T18:20:55.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:55.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj213 datafile 2020-02-08T18:20:56.012 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.012 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj214 datafile 2020-02-08T18:20:56.065 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.065 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj215 datafile 2020-02-08T18:20:56.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj216 datafile 2020-02-08T18:20:56.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj217 datafile 2020-02-08T18:20:56.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj218 datafile 2020-02-08T18:20:56.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj219 datafile 2020-02-08T18:20:56.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj220 datafile 2020-02-08T18:20:56.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj221 datafile 2020-02-08T18:20:56.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj222 datafile 2020-02-08T18:20:56.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj223 datafile 2020-02-08T18:20:56.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj224 datafile 2020-02-08T18:20:56.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj225 datafile 2020-02-08T18:20:56.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:56.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj226 datafile 2020-02-08T18:20:57.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj227 datafile 2020-02-08T18:20:57.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj228 datafile 2020-02-08T18:20:57.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj229 datafile 2020-02-08T18:20:57.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj230 datafile 2020-02-08T18:20:57.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj231 datafile 2020-02-08T18:20:57.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj232 datafile 2020-02-08T18:20:57.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj233 datafile 2020-02-08T18:20:57.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj234 datafile 2020-02-08T18:20:57.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj235 datafile 2020-02-08T18:20:57.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj236 datafile 2020-02-08T18:20:57.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj237 datafile 2020-02-08T18:20:57.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.772 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj238 datafile 2020-02-08T18:20:57.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj239 datafile 2020-02-08T18:20:57.872 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.872 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj240 datafile 2020-02-08T18:20:57.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj241 datafile 2020-02-08T18:20:57.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:57.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj242 datafile 2020-02-08T18:20:58.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj243 datafile 2020-02-08T18:20:58.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj244 datafile 2020-02-08T18:20:58.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj245 datafile 2020-02-08T18:20:58.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj246 datafile 2020-02-08T18:20:58.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj247 datafile 2020-02-08T18:20:58.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj248 datafile 2020-02-08T18:20:58.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj249 datafile 2020-02-08T18:20:58.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj250 datafile 2020-02-08T18:20:58.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj251 datafile 2020-02-08T18:20:58.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj252 datafile 2020-02-08T18:20:58.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj253 datafile 2020-02-08T18:20:58.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj254 datafile 2020-02-08T18:20:58.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.859 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj255 datafile 2020-02-08T18:20:58.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:58.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj256 datafile 2020-02-08T18:20:59.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj257 datafile 2020-02-08T18:20:59.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj258 datafile 2020-02-08T18:20:59.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj259 datafile 2020-02-08T18:20:59.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj260 datafile 2020-02-08T18:20:59.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj261 datafile 2020-02-08T18:20:59.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj262 datafile 2020-02-08T18:20:59.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj263 datafile 2020-02-08T18:20:59.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj264 datafile 2020-02-08T18:20:59.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj265 datafile 2020-02-08T18:20:59.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj266 datafile 2020-02-08T18:20:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj267 datafile 2020-02-08T18:20:59.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj268 datafile 2020-02-08T18:20:59.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj269 datafile 2020-02-08T18:20:59.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:20:59.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj270 datafile 2020-02-08T18:21:00.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj271 datafile 2020-02-08T18:21:00.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj272 datafile 2020-02-08T18:21:00.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj273 datafile 2020-02-08T18:21:00.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj274 datafile 2020-02-08T18:21:00.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj275 datafile 2020-02-08T18:21:00.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj276 datafile 2020-02-08T18:21:00.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj277 datafile 2020-02-08T18:21:00.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj278 datafile 2020-02-08T18:21:00.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj279 datafile 2020-02-08T18:21:00.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj280 datafile 2020-02-08T18:21:00.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj281 datafile 2020-02-08T18:21:00.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj282 datafile 2020-02-08T18:21:00.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj283 datafile 2020-02-08T18:21:00.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj284 datafile 2020-02-08T18:21:00.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj285 datafile 2020-02-08T18:21:00.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:00.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj286 datafile 2020-02-08T18:21:01.035 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.036 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj287 datafile 2020-02-08T18:21:01.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj288 datafile 2020-02-08T18:21:01.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj289 datafile 2020-02-08T18:21:01.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj290 datafile 2020-02-08T18:21:01.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj291 datafile 2020-02-08T18:21:01.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj292 datafile 2020-02-08T18:21:01.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj293 datafile 2020-02-08T18:21:01.604 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.605 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj294 datafile 2020-02-08T18:21:01.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj295 datafile 2020-02-08T18:21:01.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj296 datafile 2020-02-08T18:21:01.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj297 datafile 2020-02-08T18:21:01.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj298 datafile 2020-02-08T18:21:01.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj299 datafile 2020-02-08T18:21:01.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj300 datafile 2020-02-08T18:21:01.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:01.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj301 datafile 2020-02-08T18:21:02.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj302 datafile 2020-02-08T18:21:02.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.160 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj303 datafile 2020-02-08T18:21:02.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj304 datafile 2020-02-08T18:21:02.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj305 datafile 2020-02-08T18:21:02.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj306 datafile 2020-02-08T18:21:02.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj307 datafile 2020-02-08T18:21:02.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj308 datafile 2020-02-08T18:21:02.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj309 datafile 2020-02-08T18:21:02.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj310 datafile 2020-02-08T18:21:02.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj311 datafile 2020-02-08T18:21:02.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj312 datafile 2020-02-08T18:21:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj313 datafile 2020-02-08T18:21:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:02.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj314 datafile 2020-02-08T18:21:03.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj315 datafile 2020-02-08T18:21:03.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj316 datafile 2020-02-08T18:21:03.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj317 datafile 2020-02-08T18:21:03.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj318 datafile 2020-02-08T18:21:03.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj319 datafile 2020-02-08T18:21:03.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj320 datafile 2020-02-08T18:21:03.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj321 datafile 2020-02-08T18:21:03.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj322 datafile 2020-02-08T18:21:03.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj323 datafile 2020-02-08T18:21:03.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj324 datafile 2020-02-08T18:21:03.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj325 datafile 2020-02-08T18:21:03.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj326 datafile 2020-02-08T18:21:03.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj327 datafile 2020-02-08T18:21:03.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:03.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj328 datafile 2020-02-08T18:21:04.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj329 datafile 2020-02-08T18:21:04.074 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.074 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj330 datafile 2020-02-08T18:21:04.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj331 datafile 2020-02-08T18:21:04.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj332 datafile 2020-02-08T18:21:04.307 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.307 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj333 datafile 2020-02-08T18:21:04.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj334 datafile 2020-02-08T18:21:04.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj335 datafile 2020-02-08T18:21:04.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj336 datafile 2020-02-08T18:21:04.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj337 datafile 2020-02-08T18:21:04.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj338 datafile 2020-02-08T18:21:04.697 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj339 datafile 2020-02-08T18:21:04.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj340 datafile 2020-02-08T18:21:04.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.814 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj341 datafile 2020-02-08T18:21:04.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj342 datafile 2020-02-08T18:21:04.989 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:04.989 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj343 datafile 2020-02-08T18:21:05.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj344 datafile 2020-02-08T18:21:05.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj345 datafile 2020-02-08T18:21:05.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj346 datafile 2020-02-08T18:21:05.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj347 datafile 2020-02-08T18:21:05.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj348 datafile 2020-02-08T18:21:05.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj349 datafile 2020-02-08T18:21:05.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj350 datafile 2020-02-08T18:21:05.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj351 datafile 2020-02-08T18:21:05.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj352 datafile 2020-02-08T18:21:05.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj353 datafile 2020-02-08T18:21:05.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj354 datafile 2020-02-08T18:21:05.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj355 datafile 2020-02-08T18:21:05.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj356 datafile 2020-02-08T18:21:05.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj357 datafile 2020-02-08T18:21:05.988 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:05.988 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj358 datafile 2020-02-08T18:21:06.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj359 datafile 2020-02-08T18:21:06.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj360 datafile 2020-02-08T18:21:06.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj361 datafile 2020-02-08T18:21:06.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj362 datafile 2020-02-08T18:21:06.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj363 datafile 2020-02-08T18:21:06.414 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.415 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj364 datafile 2020-02-08T18:21:06.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj365 datafile 2020-02-08T18:21:06.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj366 datafile 2020-02-08T18:21:06.678 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.678 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj367 datafile 2020-02-08T18:21:06.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj368 datafile 2020-02-08T18:21:06.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj369 datafile 2020-02-08T18:21:06.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj370 datafile 2020-02-08T18:21:06.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:06.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj371 datafile 2020-02-08T18:21:07.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj372 datafile 2020-02-08T18:21:07.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj373 datafile 2020-02-08T18:21:07.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj374 datafile 2020-02-08T18:21:07.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj375 datafile 2020-02-08T18:21:07.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj376 datafile 2020-02-08T18:21:07.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj377 datafile 2020-02-08T18:21:07.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj378 datafile 2020-02-08T18:21:07.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj379 datafile 2020-02-08T18:21:07.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj380 datafile 2020-02-08T18:21:07.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj381 datafile 2020-02-08T18:21:07.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj382 datafile 2020-02-08T18:21:07.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj383 datafile 2020-02-08T18:21:07.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj384 datafile 2020-02-08T18:21:07.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:07.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj385 datafile 2020-02-08T18:21:08.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj386 datafile 2020-02-08T18:21:08.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj387 datafile 2020-02-08T18:21:08.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj388 datafile 2020-02-08T18:21:08.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj389 datafile 2020-02-08T18:21:08.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj390 datafile 2020-02-08T18:21:08.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj391 datafile 2020-02-08T18:21:08.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj392 datafile 2020-02-08T18:21:08.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj393 datafile 2020-02-08T18:21:08.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj394 datafile 2020-02-08T18:21:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj395 datafile 2020-02-08T18:21:08.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj396 datafile 2020-02-08T18:21:08.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj397 datafile 2020-02-08T18:21:08.822 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.822 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj398 datafile 2020-02-08T18:21:08.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:08.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj399 datafile 2020-02-08T18:21:09.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj400 datafile 2020-02-08T18:21:09.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj401 datafile 2020-02-08T18:21:09.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj402 datafile 2020-02-08T18:21:09.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj403 datafile 2020-02-08T18:21:09.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj404 datafile 2020-02-08T18:21:09.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.309 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj405 datafile 2020-02-08T18:21:09.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj406 datafile 2020-02-08T18:21:09.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj407 datafile 2020-02-08T18:21:09.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj408 datafile 2020-02-08T18:21:09.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj409 datafile 2020-02-08T18:21:09.644 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.644 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj410 datafile 2020-02-08T18:21:09.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj411 datafile 2020-02-08T18:21:09.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj412 datafile 2020-02-08T18:21:09.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj413 datafile 2020-02-08T18:21:09.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj414 datafile 2020-02-08T18:21:09.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:09.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj415 datafile 2020-02-08T18:21:10.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.030 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj416 datafile 2020-02-08T18:21:10.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj417 datafile 2020-02-08T18:21:10.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj418 datafile 2020-02-08T18:21:10.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj419 datafile 2020-02-08T18:21:10.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj420 datafile 2020-02-08T18:21:10.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj421 datafile 2020-02-08T18:21:10.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj422 datafile 2020-02-08T18:21:10.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj423 datafile 2020-02-08T18:21:10.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj424 datafile 2020-02-08T18:21:10.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj425 datafile 2020-02-08T18:21:10.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj426 datafile 2020-02-08T18:21:10.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj427 datafile 2020-02-08T18:21:10.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj428 datafile 2020-02-08T18:21:10.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:10.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj429 datafile 2020-02-08T18:21:11.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj430 datafile 2020-02-08T18:21:11.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.089 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj431 datafile 2020-02-08T18:21:11.252 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.252 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj432 datafile 2020-02-08T18:21:11.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj433 datafile 2020-02-08T18:21:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj434 datafile 2020-02-08T18:21:11.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj435 datafile 2020-02-08T18:21:11.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj436 datafile 2020-02-08T18:21:11.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj437 datafile 2020-02-08T18:21:11.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj438 datafile 2020-02-08T18:21:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj439 datafile 2020-02-08T18:21:11.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj440 datafile 2020-02-08T18:21:11.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj441 datafile 2020-02-08T18:21:11.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj442 datafile 2020-02-08T18:21:11.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:11.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj443 datafile 2020-02-08T18:21:12.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj444 datafile 2020-02-08T18:21:12.055 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.056 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj445 datafile 2020-02-08T18:21:12.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj446 datafile 2020-02-08T18:21:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.185 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj447 datafile 2020-02-08T18:21:12.234 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj448 datafile 2020-02-08T18:21:12.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj449 datafile 2020-02-08T18:21:12.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.386 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj450 datafile 2020-02-08T18:21:12.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj451 datafile 2020-02-08T18:21:12.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj452 datafile 2020-02-08T18:21:12.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj453 datafile 2020-02-08T18:21:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj454 datafile 2020-02-08T18:21:12.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj455 datafile 2020-02-08T18:21:12.793 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.793 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj456 datafile 2020-02-08T18:21:12.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj457 datafile 2020-02-08T18:21:12.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:12.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj458 datafile 2020-02-08T18:21:13.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj459 datafile 2020-02-08T18:21:13.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj460 datafile 2020-02-08T18:21:13.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj461 datafile 2020-02-08T18:21:13.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj462 datafile 2020-02-08T18:21:13.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj463 datafile 2020-02-08T18:21:13.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj464 datafile 2020-02-08T18:21:13.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj465 datafile 2020-02-08T18:21:13.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj466 datafile 2020-02-08T18:21:13.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj467 datafile 2020-02-08T18:21:13.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj468 datafile 2020-02-08T18:21:13.593 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.593 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj469 datafile 2020-02-08T18:21:13.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj470 datafile 2020-02-08T18:21:13.806 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.806 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj471 datafile 2020-02-08T18:21:13.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj472 datafile 2020-02-08T18:21:13.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj473 datafile 2020-02-08T18:21:13.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:13.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj474 datafile 2020-02-08T18:21:14.008 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj475 datafile 2020-02-08T18:21:14.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj476 datafile 2020-02-08T18:21:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj477 datafile 2020-02-08T18:21:14.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj478 datafile 2020-02-08T18:21:14.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj479 datafile 2020-02-08T18:21:14.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj480 datafile 2020-02-08T18:21:14.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj481 datafile 2020-02-08T18:21:14.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj482 datafile 2020-02-08T18:21:14.593 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj483 datafile 2020-02-08T18:21:14.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj484 datafile 2020-02-08T18:21:14.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj485 datafile 2020-02-08T18:21:14.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj486 datafile 2020-02-08T18:21:14.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj487 datafile 2020-02-08T18:21:14.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:14.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj488 datafile 2020-02-08T18:21:15.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj489 datafile 2020-02-08T18:21:15.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj490 datafile 2020-02-08T18:21:15.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj491 datafile 2020-02-08T18:21:15.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj492 datafile 2020-02-08T18:21:15.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj493 datafile 2020-02-08T18:21:15.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj494 datafile 2020-02-08T18:21:15.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj495 datafile 2020-02-08T18:21:15.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj496 datafile 2020-02-08T18:21:15.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj497 datafile 2020-02-08T18:21:15.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj498 datafile 2020-02-08T18:21:15.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj499 datafile 2020-02-08T18:21:15.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj500 datafile 2020-02-08T18:21:15.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj501 datafile 2020-02-08T18:21:15.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:15.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj502 datafile 2020-02-08T18:21:16.021 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.021 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj503 datafile 2020-02-08T18:21:16.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj504 datafile 2020-02-08T18:21:16.180 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.180 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj505 datafile 2020-02-08T18:21:16.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj506 datafile 2020-02-08T18:21:16.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj507 datafile 2020-02-08T18:21:16.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj508 datafile 2020-02-08T18:21:16.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.375 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj509 datafile 2020-02-08T18:21:16.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj510 datafile 2020-02-08T18:21:16.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj511 datafile 2020-02-08T18:21:16.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj512 datafile 2020-02-08T18:21:16.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj513 datafile 2020-02-08T18:21:16.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj514 datafile 2020-02-08T18:21:16.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj515 datafile 2020-02-08T18:21:16.857 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj516 datafile 2020-02-08T18:21:16.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj517 datafile 2020-02-08T18:21:16.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:16.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj518 datafile 2020-02-08T18:21:17.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj519 datafile 2020-02-08T18:21:17.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj520 datafile 2020-02-08T18:21:17.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj521 datafile 2020-02-08T18:21:17.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj522 datafile 2020-02-08T18:21:17.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj523 datafile 2020-02-08T18:21:17.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj524 datafile 2020-02-08T18:21:17.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj525 datafile 2020-02-08T18:21:17.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj526 datafile 2020-02-08T18:21:17.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj527 datafile 2020-02-08T18:21:17.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj528 datafile 2020-02-08T18:21:17.702 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.702 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj529 datafile 2020-02-08T18:21:17.793 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj530 datafile 2020-02-08T18:21:17.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj531 datafile 2020-02-08T18:21:17.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj532 datafile 2020-02-08T18:21:17.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:17.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj533 datafile 2020-02-08T18:21:18.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:18.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj534 datafile 2020-02-08T18:21:18.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:18.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj535 datafile 2020-02-08T18:21:18.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:18.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj536 datafile 2020-02-08T18:21:18.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:18.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj537 datafile 2020-02-08T18:21:18.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:18.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj538 datafile 2020-02-08T18:21:18.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:18.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj539 datafile 2020-02-08T18:21:19.030 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj540 datafile 2020-02-08T18:21:19.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj541 datafile 2020-02-08T18:21:19.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj542 datafile 2020-02-08T18:21:19.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj543 datafile 2020-02-08T18:21:19.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj544 datafile 2020-02-08T18:21:19.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj545 datafile 2020-02-08T18:21:19.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj546 datafile 2020-02-08T18:21:19.520 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj547 datafile 2020-02-08T18:21:19.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj548 datafile 2020-02-08T18:21:19.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj549 datafile 2020-02-08T18:21:19.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj550 datafile 2020-02-08T18:21:19.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj551 datafile 2020-02-08T18:21:19.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.857 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj552 datafile 2020-02-08T18:21:19.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:19.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj553 datafile 2020-02-08T18:21:20.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj554 datafile 2020-02-08T18:21:20.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj555 datafile 2020-02-08T18:21:20.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj556 datafile 2020-02-08T18:21:20.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj557 datafile 2020-02-08T18:21:20.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj558 datafile 2020-02-08T18:21:20.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj559 datafile 2020-02-08T18:21:20.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj560 datafile 2020-02-08T18:21:20.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj561 datafile 2020-02-08T18:21:20.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj562 datafile 2020-02-08T18:21:20.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj563 datafile 2020-02-08T18:21:20.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj564 datafile 2020-02-08T18:21:20.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj565 datafile 2020-02-08T18:21:20.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj566 datafile 2020-02-08T18:21:20.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj567 datafile 2020-02-08T18:21:20.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:20.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj568 datafile 2020-02-08T18:21:21.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj569 datafile 2020-02-08T18:21:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj570 datafile 2020-02-08T18:21:21.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj571 datafile 2020-02-08T18:21:21.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj572 datafile 2020-02-08T18:21:21.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj573 datafile 2020-02-08T18:21:21.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj574 datafile 2020-02-08T18:21:21.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj575 datafile 2020-02-08T18:21:21.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj576 datafile 2020-02-08T18:21:21.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj577 datafile 2020-02-08T18:21:21.566 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj578 datafile 2020-02-08T18:21:21.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj579 datafile 2020-02-08T18:21:21.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj580 datafile 2020-02-08T18:21:21.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.779 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj581 datafile 2020-02-08T18:21:21.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj582 datafile 2020-02-08T18:21:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj583 datafile 2020-02-08T18:21:21.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:21.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj584 datafile 2020-02-08T18:21:22.012 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.012 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj585 datafile 2020-02-08T18:21:22.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj586 datafile 2020-02-08T18:21:22.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj587 datafile 2020-02-08T18:21:22.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj588 datafile 2020-02-08T18:21:22.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj589 datafile 2020-02-08T18:21:22.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.309 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj590 datafile 2020-02-08T18:21:22.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj591 datafile 2020-02-08T18:21:22.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj592 datafile 2020-02-08T18:21:22.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj593 datafile 2020-02-08T18:21:22.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj594 datafile 2020-02-08T18:21:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.779 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj595 datafile 2020-02-08T18:21:22.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj596 datafile 2020-02-08T18:21:22.875 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj597 datafile 2020-02-08T18:21:22.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj598 datafile 2020-02-08T18:21:22.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:22.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj599 datafile 2020-02-08T18:21:23.012 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj600 datafile 2020-02-08T18:21:23.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj601 datafile 2020-02-08T18:21:23.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj602 datafile 2020-02-08T18:21:23.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj603 datafile 2020-02-08T18:21:23.392 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.392 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj604 datafile 2020-02-08T18:21:23.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj605 datafile 2020-02-08T18:21:23.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj606 datafile 2020-02-08T18:21:23.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj607 datafile 2020-02-08T18:21:23.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj608 datafile 2020-02-08T18:21:23.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj609 datafile 2020-02-08T18:21:23.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj610 datafile 2020-02-08T18:21:23.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj611 datafile 2020-02-08T18:21:23.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.919 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj612 datafile 2020-02-08T18:21:23.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:23.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj613 datafile 2020-02-08T18:21:24.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj614 datafile 2020-02-08T18:21:24.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj615 datafile 2020-02-08T18:21:24.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj616 datafile 2020-02-08T18:21:24.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj617 datafile 2020-02-08T18:21:24.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj618 datafile 2020-02-08T18:21:24.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj619 datafile 2020-02-08T18:21:24.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj620 datafile 2020-02-08T18:21:24.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj621 datafile 2020-02-08T18:21:24.580 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.580 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj622 datafile 2020-02-08T18:21:24.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj623 datafile 2020-02-08T18:21:24.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj624 datafile 2020-02-08T18:21:24.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj625 datafile 2020-02-08T18:21:24.830 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.830 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj626 datafile 2020-02-08T18:21:24.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj627 datafile 2020-02-08T18:21:24.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:24.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj628 datafile 2020-02-08T18:21:25.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj629 datafile 2020-02-08T18:21:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj630 datafile 2020-02-08T18:21:25.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj631 datafile 2020-02-08T18:21:25.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.223 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj632 datafile 2020-02-08T18:21:25.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj633 datafile 2020-02-08T18:21:25.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj634 datafile 2020-02-08T18:21:25.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj635 datafile 2020-02-08T18:21:25.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj636 datafile 2020-02-08T18:21:25.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj637 datafile 2020-02-08T18:21:25.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj638 datafile 2020-02-08T18:21:25.663 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.663 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj639 datafile 2020-02-08T18:21:25.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj640 datafile 2020-02-08T18:21:25.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj641 datafile 2020-02-08T18:21:25.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:25.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj642 datafile 2020-02-08T18:21:26.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj643 datafile 2020-02-08T18:21:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj644 datafile 2020-02-08T18:21:26.193 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.193 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj645 datafile 2020-02-08T18:21:26.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj646 datafile 2020-02-08T18:21:26.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj647 datafile 2020-02-08T18:21:26.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj648 datafile 2020-02-08T18:21:26.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj649 datafile 2020-02-08T18:21:26.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj650 datafile 2020-02-08T18:21:26.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj651 datafile 2020-02-08T18:21:26.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj652 datafile 2020-02-08T18:21:26.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj653 datafile 2020-02-08T18:21:26.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj654 datafile 2020-02-08T18:21:26.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj655 datafile 2020-02-08T18:21:26.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:26.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj656 datafile 2020-02-08T18:21:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj657 datafile 2020-02-08T18:21:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.087 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj658 datafile 2020-02-08T18:21:27.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj659 datafile 2020-02-08T18:21:27.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj660 datafile 2020-02-08T18:21:27.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj661 datafile 2020-02-08T18:21:27.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj662 datafile 2020-02-08T18:21:27.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj663 datafile 2020-02-08T18:21:27.413 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.413 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj664 datafile 2020-02-08T18:21:27.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj665 datafile 2020-02-08T18:21:27.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj666 datafile 2020-02-08T18:21:27.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj667 datafile 2020-02-08T18:21:27.697 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj668 datafile 2020-02-08T18:21:27.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj669 datafile 2020-02-08T18:21:27.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj670 datafile 2020-02-08T18:21:27.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:27.966 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj671 datafile 2020-02-08T18:21:28.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj672 datafile 2020-02-08T18:21:28.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj673 datafile 2020-02-08T18:21:28.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj674 datafile 2020-02-08T18:21:28.175 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.175 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj675 datafile 2020-02-08T18:21:28.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj676 datafile 2020-02-08T18:21:28.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj677 datafile 2020-02-08T18:21:28.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj678 datafile 2020-02-08T18:21:28.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj679 datafile 2020-02-08T18:21:28.566 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj680 datafile 2020-02-08T18:21:28.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj681 datafile 2020-02-08T18:21:28.717 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj682 datafile 2020-02-08T18:21:28.764 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.764 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj683 datafile 2020-02-08T18:21:28.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj684 datafile 2020-02-08T18:21:28.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:28.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj685 datafile 2020-02-08T18:21:29.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj686 datafile 2020-02-08T18:21:29.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj687 datafile 2020-02-08T18:21:29.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj688 datafile 2020-02-08T18:21:29.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj689 datafile 2020-02-08T18:21:29.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj690 datafile 2020-02-08T18:21:29.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj691 datafile 2020-02-08T18:21:29.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj692 datafile 2020-02-08T18:21:29.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj693 datafile 2020-02-08T18:21:29.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj694 datafile 2020-02-08T18:21:29.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj695 datafile 2020-02-08T18:21:29.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj696 datafile 2020-02-08T18:21:29.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj697 datafile 2020-02-08T18:21:29.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj698 datafile 2020-02-08T18:21:29.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj699 datafile 2020-02-08T18:21:29.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:29.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj700 datafile 2020-02-08T18:21:30.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj701 datafile 2020-02-08T18:21:30.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj702 datafile 2020-02-08T18:21:30.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj703 datafile 2020-02-08T18:21:30.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj704 datafile 2020-02-08T18:21:30.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj705 datafile 2020-02-08T18:21:30.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj706 datafile 2020-02-08T18:21:30.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj707 datafile 2020-02-08T18:21:30.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj708 datafile 2020-02-08T18:21:30.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj709 datafile 2020-02-08T18:21:30.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj710 datafile 2020-02-08T18:21:30.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj711 datafile 2020-02-08T18:21:30.772 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj712 datafile 2020-02-08T18:21:30.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj713 datafile 2020-02-08T18:21:30.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj714 datafile 2020-02-08T18:21:30.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:30.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj715 datafile 2020-02-08T18:21:31.081 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj716 datafile 2020-02-08T18:21:31.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj717 datafile 2020-02-08T18:21:31.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj718 datafile 2020-02-08T18:21:31.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj719 datafile 2020-02-08T18:21:31.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj720 datafile 2020-02-08T18:21:31.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj721 datafile 2020-02-08T18:21:31.580 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj722 datafile 2020-02-08T18:21:31.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj723 datafile 2020-02-08T18:21:31.768 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.768 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj724 datafile 2020-02-08T18:21:31.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj725 datafile 2020-02-08T18:21:31.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj726 datafile 2020-02-08T18:21:31.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:31.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj727 datafile 2020-02-08T18:21:32.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj728 datafile 2020-02-08T18:21:32.055 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.056 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj729 datafile 2020-02-08T18:21:32.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj730 datafile 2020-02-08T18:21:32.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.219 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj731 datafile 2020-02-08T18:21:32.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj732 datafile 2020-02-08T18:21:32.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj733 datafile 2020-02-08T18:21:32.359 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.359 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj734 datafile 2020-02-08T18:21:32.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.478 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj735 datafile 2020-02-08T18:21:32.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj736 datafile 2020-02-08T18:21:32.577 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.577 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj737 datafile 2020-02-08T18:21:32.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj738 datafile 2020-02-08T18:21:32.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj739 datafile 2020-02-08T18:21:32.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj740 datafile 2020-02-08T18:21:32.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj741 datafile 2020-02-08T18:21:32.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:32.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj742 datafile 2020-02-08T18:21:33.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj743 datafile 2020-02-08T18:21:33.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj744 datafile 2020-02-08T18:21:33.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj745 datafile 2020-02-08T18:21:33.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj746 datafile 2020-02-08T18:21:33.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj747 datafile 2020-02-08T18:21:33.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj748 datafile 2020-02-08T18:21:33.465 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj749 datafile 2020-02-08T18:21:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj750 datafile 2020-02-08T18:21:33.555 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj751 datafile 2020-02-08T18:21:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj752 datafile 2020-02-08T18:21:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj753 datafile 2020-02-08T18:21:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj754 datafile 2020-02-08T18:21:33.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj755 datafile 2020-02-08T18:21:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj756 datafile 2020-02-08T18:21:33.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj757 datafile 2020-02-08T18:21:33.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:33.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj758 datafile 2020-02-08T18:21:34.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj759 datafile 2020-02-08T18:21:34.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj760 datafile 2020-02-08T18:21:34.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj761 datafile 2020-02-08T18:21:34.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj762 datafile 2020-02-08T18:21:34.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj763 datafile 2020-02-08T18:21:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj764 datafile 2020-02-08T18:21:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj765 datafile 2020-02-08T18:21:34.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj766 datafile 2020-02-08T18:21:34.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj767 datafile 2020-02-08T18:21:34.872 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj768 datafile 2020-02-08T18:21:34.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj769 datafile 2020-02-08T18:21:34.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:34.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj770 datafile 2020-02-08T18:21:35.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj771 datafile 2020-02-08T18:21:35.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj772 datafile 2020-02-08T18:21:35.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj773 datafile 2020-02-08T18:21:35.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj774 datafile 2020-02-08T18:21:35.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj775 datafile 2020-02-08T18:21:35.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj776 datafile 2020-02-08T18:21:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj777 datafile 2020-02-08T18:21:35.520 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.520 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj778 datafile 2020-02-08T18:21:35.576 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.576 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj779 datafile 2020-02-08T18:21:35.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj780 datafile 2020-02-08T18:21:35.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj781 datafile 2020-02-08T18:21:35.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.753 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj782 datafile 2020-02-08T18:21:35.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj783 datafile 2020-02-08T18:21:35.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj784 datafile 2020-02-08T18:21:35.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:35.977 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj785 datafile 2020-02-08T18:21:36.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj786 datafile 2020-02-08T18:21:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj787 datafile 2020-02-08T18:21:36.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj788 datafile 2020-02-08T18:21:36.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj789 datafile 2020-02-08T18:21:36.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj790 datafile 2020-02-08T18:21:36.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj791 datafile 2020-02-08T18:21:36.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj792 datafile 2020-02-08T18:21:36.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj793 datafile 2020-02-08T18:21:36.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj794 datafile 2020-02-08T18:21:36.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj795 datafile 2020-02-08T18:21:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj796 datafile 2020-02-08T18:21:36.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj797 datafile 2020-02-08T18:21:36.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj798 datafile 2020-02-08T18:21:36.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:36.966 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj799 datafile 2020-02-08T18:21:37.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.019 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj800 datafile 2020-02-08T18:21:37.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj801 datafile 2020-02-08T18:21:37.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj802 datafile 2020-02-08T18:21:37.259 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj803 datafile 2020-02-08T18:21:37.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj804 datafile 2020-02-08T18:21:37.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj805 datafile 2020-02-08T18:21:37.467 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.467 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj806 datafile 2020-02-08T18:21:37.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj807 datafile 2020-02-08T18:21:37.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj808 datafile 2020-02-08T18:21:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj809 datafile 2020-02-08T18:21:37.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj810 datafile 2020-02-08T18:21:37.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj811 datafile 2020-02-08T18:21:37.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj812 datafile 2020-02-08T18:21:37.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj813 datafile 2020-02-08T18:21:37.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:37.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj814 datafile 2020-02-08T18:21:38.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj815 datafile 2020-02-08T18:21:38.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj816 datafile 2020-02-08T18:21:38.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj817 datafile 2020-02-08T18:21:38.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj818 datafile 2020-02-08T18:21:38.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj819 datafile 2020-02-08T18:21:38.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj820 datafile 2020-02-08T18:21:38.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj821 datafile 2020-02-08T18:21:38.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj822 datafile 2020-02-08T18:21:38.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj823 datafile 2020-02-08T18:21:38.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj824 datafile 2020-02-08T18:21:38.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj825 datafile 2020-02-08T18:21:38.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:38.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj826 datafile 2020-02-08T18:21:39.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj827 datafile 2020-02-08T18:21:39.081 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.081 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj828 datafile 2020-02-08T18:21:39.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj829 datafile 2020-02-08T18:21:39.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj830 datafile 2020-02-08T18:21:39.246 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj831 datafile 2020-02-08T18:21:39.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj832 datafile 2020-02-08T18:21:39.342 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.342 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj833 datafile 2020-02-08T18:21:39.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj834 datafile 2020-02-08T18:21:39.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj835 datafile 2020-02-08T18:21:39.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj836 datafile 2020-02-08T18:21:39.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj837 datafile 2020-02-08T18:21:39.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj838 datafile 2020-02-08T18:21:39.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj839 datafile 2020-02-08T18:21:39.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj840 datafile 2020-02-08T18:21:39.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:39.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj841 datafile 2020-02-08T18:21:40.015 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj842 datafile 2020-02-08T18:21:40.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj843 datafile 2020-02-08T18:21:40.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj844 datafile 2020-02-08T18:21:40.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj845 datafile 2020-02-08T18:21:40.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj846 datafile 2020-02-08T18:21:40.376 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.376 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj847 datafile 2020-02-08T18:21:40.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj848 datafile 2020-02-08T18:21:40.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj849 datafile 2020-02-08T18:21:40.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj850 datafile 2020-02-08T18:21:40.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj851 datafile 2020-02-08T18:21:40.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj852 datafile 2020-02-08T18:21:40.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj853 datafile 2020-02-08T18:21:40.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj854 datafile 2020-02-08T18:21:40.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:40.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj855 datafile 2020-02-08T18:21:41.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj856 datafile 2020-02-08T18:21:41.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj857 datafile 2020-02-08T18:21:41.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj858 datafile 2020-02-08T18:21:41.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj859 datafile 2020-02-08T18:21:41.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj860 datafile 2020-02-08T18:21:41.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj861 datafile 2020-02-08T18:21:41.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj862 datafile 2020-02-08T18:21:41.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj863 datafile 2020-02-08T18:21:41.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj864 datafile 2020-02-08T18:21:41.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj865 datafile 2020-02-08T18:21:41.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj866 datafile 2020-02-08T18:21:41.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj867 datafile 2020-02-08T18:21:41.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj868 datafile 2020-02-08T18:21:41.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:41.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj869 datafile 2020-02-08T18:21:42.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj870 datafile 2020-02-08T18:21:42.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj871 datafile 2020-02-08T18:21:42.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj872 datafile 2020-02-08T18:21:42.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj873 datafile 2020-02-08T18:21:42.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj874 datafile 2020-02-08T18:21:42.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj875 datafile 2020-02-08T18:21:42.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj876 datafile 2020-02-08T18:21:42.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj877 datafile 2020-02-08T18:21:42.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj878 datafile 2020-02-08T18:21:42.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj879 datafile 2020-02-08T18:21:42.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj880 datafile 2020-02-08T18:21:42.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.823 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj881 datafile 2020-02-08T18:21:42.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj882 datafile 2020-02-08T18:21:42.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:42.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj883 datafile 2020-02-08T18:21:43.015 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj884 datafile 2020-02-08T18:21:43.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj885 datafile 2020-02-08T18:21:43.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj886 datafile 2020-02-08T18:21:43.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj887 datafile 2020-02-08T18:21:43.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj888 datafile 2020-02-08T18:21:43.293 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj889 datafile 2020-02-08T18:21:43.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj890 datafile 2020-02-08T18:21:43.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj891 datafile 2020-02-08T18:21:43.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj892 datafile 2020-02-08T18:21:43.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj893 datafile 2020-02-08T18:21:43.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.693 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj894 datafile 2020-02-08T18:21:43.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj895 datafile 2020-02-08T18:21:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj896 datafile 2020-02-08T18:21:43.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj897 datafile 2020-02-08T18:21:43.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:43.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj898 datafile 2020-02-08T18:21:44.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj899 datafile 2020-02-08T18:21:44.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj900 datafile 2020-02-08T18:21:44.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj901 datafile 2020-02-08T18:21:44.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj902 datafile 2020-02-08T18:21:44.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj903 datafile 2020-02-08T18:21:44.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj904 datafile 2020-02-08T18:21:44.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj905 datafile 2020-02-08T18:21:44.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj906 datafile 2020-02-08T18:21:44.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj907 datafile 2020-02-08T18:21:44.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj908 datafile 2020-02-08T18:21:44.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj909 datafile 2020-02-08T18:21:44.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj910 datafile 2020-02-08T18:21:44.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj911 datafile 2020-02-08T18:21:44.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:44.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj912 datafile 2020-02-08T18:21:45.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj913 datafile 2020-02-08T18:21:45.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj914 datafile 2020-02-08T18:21:45.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj915 datafile 2020-02-08T18:21:45.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj916 datafile 2020-02-08T18:21:45.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj917 datafile 2020-02-08T18:21:45.342 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.342 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj918 datafile 2020-02-08T18:21:45.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj919 datafile 2020-02-08T18:21:45.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj920 datafile 2020-02-08T18:21:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj921 datafile 2020-02-08T18:21:45.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj922 datafile 2020-02-08T18:21:45.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj923 datafile 2020-02-08T18:21:45.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj924 datafile 2020-02-08T18:21:45.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj925 datafile 2020-02-08T18:21:45.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj926 datafile 2020-02-08T18:21:45.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj927 datafile 2020-02-08T18:21:45.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:45.966 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj928 datafile 2020-02-08T18:21:46.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj929 datafile 2020-02-08T18:21:46.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj930 datafile 2020-02-08T18:21:46.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj931 datafile 2020-02-08T18:21:46.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj932 datafile 2020-02-08T18:21:46.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj933 datafile 2020-02-08T18:21:46.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.386 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj934 datafile 2020-02-08T18:21:46.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj935 datafile 2020-02-08T18:21:46.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj936 datafile 2020-02-08T18:21:46.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj937 datafile 2020-02-08T18:21:46.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj938 datafile 2020-02-08T18:21:46.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj939 datafile 2020-02-08T18:21:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj940 datafile 2020-02-08T18:21:46.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj941 datafile 2020-02-08T18:21:46.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:46.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj942 datafile 2020-02-08T18:21:47.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj943 datafile 2020-02-08T18:21:47.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj944 datafile 2020-02-08T18:21:47.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj945 datafile 2020-02-08T18:21:47.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj946 datafile 2020-02-08T18:21:47.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj947 datafile 2020-02-08T18:21:47.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj948 datafile 2020-02-08T18:21:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj949 datafile 2020-02-08T18:21:47.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj950 datafile 2020-02-08T18:21:47.510 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.510 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj951 datafile 2020-02-08T18:21:47.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj952 datafile 2020-02-08T18:21:47.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj953 datafile 2020-02-08T18:21:47.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj954 datafile 2020-02-08T18:21:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj955 datafile 2020-02-08T18:21:47.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj956 datafile 2020-02-08T18:21:47.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:47.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj957 datafile 2020-02-08T18:21:48.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj958 datafile 2020-02-08T18:21:48.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj959 datafile 2020-02-08T18:21:48.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj960 datafile 2020-02-08T18:21:48.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj961 datafile 2020-02-08T18:21:48.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj962 datafile 2020-02-08T18:21:48.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj963 datafile 2020-02-08T18:21:48.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj964 datafile 2020-02-08T18:21:48.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj965 datafile 2020-02-08T18:21:48.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj966 datafile 2020-02-08T18:21:48.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj967 datafile 2020-02-08T18:21:48.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj968 datafile 2020-02-08T18:21:48.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj969 datafile 2020-02-08T18:21:48.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj970 datafile 2020-02-08T18:21:48.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj971 datafile 2020-02-08T18:21:48.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:48.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj972 datafile 2020-02-08T18:21:49.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj973 datafile 2020-02-08T18:21:49.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj974 datafile 2020-02-08T18:21:49.152 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj975 datafile 2020-02-08T18:21:49.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj976 datafile 2020-02-08T18:21:49.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj977 datafile 2020-02-08T18:21:49.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj978 datafile 2020-02-08T18:21:49.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj979 datafile 2020-02-08T18:21:49.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj980 datafile 2020-02-08T18:21:49.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj981 datafile 2020-02-08T18:21:49.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj982 datafile 2020-02-08T18:21:49.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj983 datafile 2020-02-08T18:21:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj984 datafile 2020-02-08T18:21:49.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:49.836 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj985 datafile 2020-02-08T18:21:50.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:50.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj986 datafile 2020-02-08T18:21:50.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:50.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj987 datafile 2020-02-08T18:21:50.678 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:50.678 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj988 datafile 2020-02-08T18:21:50.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:50.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj989 datafile 2020-02-08T18:21:50.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:50.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj990 datafile 2020-02-08T18:21:50.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:50.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj991 datafile 2020-02-08T18:21:51.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj992 datafile 2020-02-08T18:21:51.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj993 datafile 2020-02-08T18:21:51.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj994 datafile 2020-02-08T18:21:51.296 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.296 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj995 datafile 2020-02-08T18:21:51.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj996 datafile 2020-02-08T18:21:51.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj997 datafile 2020-02-08T18:21:51.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj998 datafile 2020-02-08T18:21:51.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj999 datafile 2020-02-08T18:21:51.613 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.613 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test2 put obj1000 datafile 2020-02-08T18:21:51.755 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:72: TEST_recover_unexpected: for i in $(seq 1 $POOLS) 2020-02-08T18:21:51.756 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: seq 1 1000 2020-02-08T18:21:51.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj1 datafile 2020-02-08T18:21:51.806 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.806 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj2 datafile 2020-02-08T18:21:51.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj3 datafile 2020-02-08T18:21:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj4 datafile 2020-02-08T18:21:51.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:51.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj5 datafile 2020-02-08T18:21:52.036 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj6 datafile 2020-02-08T18:21:52.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj7 datafile 2020-02-08T18:21:52.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj8 datafile 2020-02-08T18:21:52.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj9 datafile 2020-02-08T18:21:52.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.281 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj10 datafile 2020-02-08T18:21:52.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj11 datafile 2020-02-08T18:21:52.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj12 datafile 2020-02-08T18:21:52.478 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.479 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj13 datafile 2020-02-08T18:21:52.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj14 datafile 2020-02-08T18:21:52.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj15 datafile 2020-02-08T18:21:52.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj16 datafile 2020-02-08T18:21:52.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj17 datafile 2020-02-08T18:21:52.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:52.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj18 datafile 2020-02-08T18:21:53.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj19 datafile 2020-02-08T18:21:53.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj20 datafile 2020-02-08T18:21:53.175 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.175 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj21 datafile 2020-02-08T18:21:53.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj22 datafile 2020-02-08T18:21:53.303 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj23 datafile 2020-02-08T18:21:53.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj24 datafile 2020-02-08T18:21:53.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj25 datafile 2020-02-08T18:21:53.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj26 datafile 2020-02-08T18:21:53.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj27 datafile 2020-02-08T18:21:53.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj28 datafile 2020-02-08T18:21:53.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj29 datafile 2020-02-08T18:21:53.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj30 datafile 2020-02-08T18:21:53.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj31 datafile 2020-02-08T18:21:53.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj32 datafile 2020-02-08T18:21:53.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:53.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj33 datafile 2020-02-08T18:21:54.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj34 datafile 2020-02-08T18:21:54.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj35 datafile 2020-02-08T18:21:54.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj36 datafile 2020-02-08T18:21:54.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj37 datafile 2020-02-08T18:21:54.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj38 datafile 2020-02-08T18:21:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj39 datafile 2020-02-08T18:21:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj40 datafile 2020-02-08T18:21:54.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj41 datafile 2020-02-08T18:21:54.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj42 datafile 2020-02-08T18:21:54.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj43 datafile 2020-02-08T18:21:54.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj44 datafile 2020-02-08T18:21:54.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj45 datafile 2020-02-08T18:21:54.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj46 datafile 2020-02-08T18:21:54.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:54.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj47 datafile 2020-02-08T18:21:55.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj48 datafile 2020-02-08T18:21:55.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj49 datafile 2020-02-08T18:21:55.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj50 datafile 2020-02-08T18:21:55.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj51 datafile 2020-02-08T18:21:55.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj52 datafile 2020-02-08T18:21:55.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj53 datafile 2020-02-08T18:21:55.478 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.479 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj54 datafile 2020-02-08T18:21:55.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj55 datafile 2020-02-08T18:21:55.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj56 datafile 2020-02-08T18:21:55.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.671 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj57 datafile 2020-02-08T18:21:55.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.717 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj58 datafile 2020-02-08T18:21:55.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj59 datafile 2020-02-08T18:21:55.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj60 datafile 2020-02-08T18:21:55.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:55.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj61 datafile 2020-02-08T18:21:56.017 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.017 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj62 datafile 2020-02-08T18:21:56.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj63 datafile 2020-02-08T18:21:56.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj64 datafile 2020-02-08T18:21:56.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj65 datafile 2020-02-08T18:21:56.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj66 datafile 2020-02-08T18:21:56.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj67 datafile 2020-02-08T18:21:56.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj68 datafile 2020-02-08T18:21:56.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj69 datafile 2020-02-08T18:21:56.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj70 datafile 2020-02-08T18:21:56.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj71 datafile 2020-02-08T18:21:56.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj72 datafile 2020-02-08T18:21:56.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:56.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj73 datafile 2020-02-08T18:21:57.055 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.055 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj74 datafile 2020-02-08T18:21:57.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj75 datafile 2020-02-08T18:21:57.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj76 datafile 2020-02-08T18:21:57.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj77 datafile 2020-02-08T18:21:57.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj78 datafile 2020-02-08T18:21:57.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj79 datafile 2020-02-08T18:21:57.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj80 datafile 2020-02-08T18:21:57.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj81 datafile 2020-02-08T18:21:57.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj82 datafile 2020-02-08T18:21:57.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj83 datafile 2020-02-08T18:21:57.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj84 datafile 2020-02-08T18:21:57.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj85 datafile 2020-02-08T18:21:57.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj86 datafile 2020-02-08T18:21:57.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj87 datafile 2020-02-08T18:21:57.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:57.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj88 datafile 2020-02-08T18:21:58.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj89 datafile 2020-02-08T18:21:58.070 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.071 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj90 datafile 2020-02-08T18:21:58.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj91 datafile 2020-02-08T18:21:58.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj92 datafile 2020-02-08T18:21:58.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.251 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj93 datafile 2020-02-08T18:21:58.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj94 datafile 2020-02-08T18:21:58.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj95 datafile 2020-02-08T18:21:58.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj96 datafile 2020-02-08T18:21:58.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj97 datafile 2020-02-08T18:21:58.579 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.579 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj98 datafile 2020-02-08T18:21:58.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj99 datafile 2020-02-08T18:21:58.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj100 datafile 2020-02-08T18:21:58.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj101 datafile 2020-02-08T18:21:58.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj102 datafile 2020-02-08T18:21:58.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:58.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj103 datafile 2020-02-08T18:21:59.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj104 datafile 2020-02-08T18:21:59.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj105 datafile 2020-02-08T18:21:59.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj106 datafile 2020-02-08T18:21:59.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj107 datafile 2020-02-08T18:21:59.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj108 datafile 2020-02-08T18:21:59.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj109 datafile 2020-02-08T18:21:59.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj110 datafile 2020-02-08T18:21:59.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj111 datafile 2020-02-08T18:21:59.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj112 datafile 2020-02-08T18:21:59.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj113 datafile 2020-02-08T18:21:59.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj114 datafile 2020-02-08T18:21:59.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj115 datafile 2020-02-08T18:21:59.958 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:21:59.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj116 datafile 2020-02-08T18:22:00.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj117 datafile 2020-02-08T18:22:00.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj118 datafile 2020-02-08T18:22:00.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj119 datafile 2020-02-08T18:22:00.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj120 datafile 2020-02-08T18:22:00.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj121 datafile 2020-02-08T18:22:00.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj122 datafile 2020-02-08T18:22:00.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj123 datafile 2020-02-08T18:22:00.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj124 datafile 2020-02-08T18:22:00.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj125 datafile 2020-02-08T18:22:00.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj126 datafile 2020-02-08T18:22:00.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj127 datafile 2020-02-08T18:22:00.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj128 datafile 2020-02-08T18:22:00.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj129 datafile 2020-02-08T18:22:00.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.952 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj130 datafile 2020-02-08T18:22:00.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:00.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj131 datafile 2020-02-08T18:22:01.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj132 datafile 2020-02-08T18:22:01.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj133 datafile 2020-02-08T18:22:01.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj134 datafile 2020-02-08T18:22:01.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj135 datafile 2020-02-08T18:22:01.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj136 datafile 2020-02-08T18:22:01.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj137 datafile 2020-02-08T18:22:01.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj138 datafile 2020-02-08T18:22:01.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj139 datafile 2020-02-08T18:22:01.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj140 datafile 2020-02-08T18:22:01.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj141 datafile 2020-02-08T18:22:01.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj142 datafile 2020-02-08T18:22:01.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj143 datafile 2020-02-08T18:22:01.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj144 datafile 2020-02-08T18:22:01.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:01.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj145 datafile 2020-02-08T18:22:02.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj146 datafile 2020-02-08T18:22:02.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj147 datafile 2020-02-08T18:22:02.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj148 datafile 2020-02-08T18:22:02.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj149 datafile 2020-02-08T18:22:02.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj150 datafile 2020-02-08T18:22:02.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj151 datafile 2020-02-08T18:22:02.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj152 datafile 2020-02-08T18:22:02.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj153 datafile 2020-02-08T18:22:02.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj154 datafile 2020-02-08T18:22:02.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj155 datafile 2020-02-08T18:22:02.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj156 datafile 2020-02-08T18:22:02.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj157 datafile 2020-02-08T18:22:02.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:02.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj158 datafile 2020-02-08T18:22:03.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj159 datafile 2020-02-08T18:22:03.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj160 datafile 2020-02-08T18:22:03.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj161 datafile 2020-02-08T18:22:03.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj162 datafile 2020-02-08T18:22:03.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj163 datafile 2020-02-08T18:22:03.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj164 datafile 2020-02-08T18:22:03.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj165 datafile 2020-02-08T18:22:03.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.537 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj166 datafile 2020-02-08T18:22:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj167 datafile 2020-02-08T18:22:03.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj168 datafile 2020-02-08T18:22:03.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj169 datafile 2020-02-08T18:22:03.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj170 datafile 2020-02-08T18:22:03.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:03.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj171 datafile 2020-02-08T18:22:04.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj172 datafile 2020-02-08T18:22:04.070 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.070 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj173 datafile 2020-02-08T18:22:04.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj174 datafile 2020-02-08T18:22:04.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj175 datafile 2020-02-08T18:22:04.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj176 datafile 2020-02-08T18:22:04.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj177 datafile 2020-02-08T18:22:04.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj178 datafile 2020-02-08T18:22:04.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj179 datafile 2020-02-08T18:22:04.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj180 datafile 2020-02-08T18:22:04.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj181 datafile 2020-02-08T18:22:04.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj182 datafile 2020-02-08T18:22:04.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj183 datafile 2020-02-08T18:22:04.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj184 datafile 2020-02-08T18:22:04.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj185 datafile 2020-02-08T18:22:04.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj186 datafile 2020-02-08T18:22:04.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:04.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj187 datafile 2020-02-08T18:22:05.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj188 datafile 2020-02-08T18:22:05.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.147 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj189 datafile 2020-02-08T18:22:05.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj190 datafile 2020-02-08T18:22:05.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj191 datafile 2020-02-08T18:22:05.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj192 datafile 2020-02-08T18:22:05.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj193 datafile 2020-02-08T18:22:05.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj194 datafile 2020-02-08T18:22:05.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj195 datafile 2020-02-08T18:22:05.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj196 datafile 2020-02-08T18:22:05.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj197 datafile 2020-02-08T18:22:05.737 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.737 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj198 datafile 2020-02-08T18:22:05.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj199 datafile 2020-02-08T18:22:05.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj200 datafile 2020-02-08T18:22:05.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj201 datafile 2020-02-08T18:22:05.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:05.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj202 datafile 2020-02-08T18:22:06.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj203 datafile 2020-02-08T18:22:06.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj204 datafile 2020-02-08T18:22:06.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj205 datafile 2020-02-08T18:22:06.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.221 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj206 datafile 2020-02-08T18:22:06.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj207 datafile 2020-02-08T18:22:06.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj208 datafile 2020-02-08T18:22:06.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj209 datafile 2020-02-08T18:22:06.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj210 datafile 2020-02-08T18:22:06.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj211 datafile 2020-02-08T18:22:06.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj212 datafile 2020-02-08T18:22:06.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj213 datafile 2020-02-08T18:22:06.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj214 datafile 2020-02-08T18:22:06.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:06.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj215 datafile 2020-02-08T18:22:07.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj216 datafile 2020-02-08T18:22:07.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj217 datafile 2020-02-08T18:22:07.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj218 datafile 2020-02-08T18:22:07.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj219 datafile 2020-02-08T18:22:07.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj220 datafile 2020-02-08T18:22:07.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj221 datafile 2020-02-08T18:22:07.421 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.421 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj222 datafile 2020-02-08T18:22:07.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj223 datafile 2020-02-08T18:22:07.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj224 datafile 2020-02-08T18:22:07.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj225 datafile 2020-02-08T18:22:07.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj226 datafile 2020-02-08T18:22:07.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj227 datafile 2020-02-08T18:22:07.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj228 datafile 2020-02-08T18:22:07.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj229 datafile 2020-02-08T18:22:07.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.952 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj230 datafile 2020-02-08T18:22:07.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:07.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj231 datafile 2020-02-08T18:22:08.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj232 datafile 2020-02-08T18:22:08.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj233 datafile 2020-02-08T18:22:08.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj234 datafile 2020-02-08T18:22:08.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj235 datafile 2020-02-08T18:22:08.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj236 datafile 2020-02-08T18:22:08.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj237 datafile 2020-02-08T18:22:08.467 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.468 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj238 datafile 2020-02-08T18:22:08.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj239 datafile 2020-02-08T18:22:08.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj240 datafile 2020-02-08T18:22:08.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj241 datafile 2020-02-08T18:22:08.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj242 datafile 2020-02-08T18:22:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj243 datafile 2020-02-08T18:22:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj244 datafile 2020-02-08T18:22:08.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj245 datafile 2020-02-08T18:22:08.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:08.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj246 datafile 2020-02-08T18:22:09.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj247 datafile 2020-02-08T18:22:09.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.189 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj248 datafile 2020-02-08T18:22:09.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj249 datafile 2020-02-08T18:22:09.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj250 datafile 2020-02-08T18:22:09.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj251 datafile 2020-02-08T18:22:09.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj252 datafile 2020-02-08T18:22:09.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj253 datafile 2020-02-08T18:22:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj254 datafile 2020-02-08T18:22:09.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj255 datafile 2020-02-08T18:22:09.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj256 datafile 2020-02-08T18:22:09.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj257 datafile 2020-02-08T18:22:09.840 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.840 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj258 datafile 2020-02-08T18:22:09.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:09.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj259 datafile 2020-02-08T18:22:10.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj260 datafile 2020-02-08T18:22:10.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj261 datafile 2020-02-08T18:22:10.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj262 datafile 2020-02-08T18:22:10.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj263 datafile 2020-02-08T18:22:10.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj264 datafile 2020-02-08T18:22:10.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj265 datafile 2020-02-08T18:22:10.393 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj266 datafile 2020-02-08T18:22:10.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj267 datafile 2020-02-08T18:22:10.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj268 datafile 2020-02-08T18:22:10.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj269 datafile 2020-02-08T18:22:10.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj270 datafile 2020-02-08T18:22:10.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj271 datafile 2020-02-08T18:22:10.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj272 datafile 2020-02-08T18:22:10.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:10.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj273 datafile 2020-02-08T18:22:11.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.018 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj274 datafile 2020-02-08T18:22:11.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj275 datafile 2020-02-08T18:22:11.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj276 datafile 2020-02-08T18:22:11.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj277 datafile 2020-02-08T18:22:11.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj278 datafile 2020-02-08T18:22:11.386 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.386 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj279 datafile 2020-02-08T18:22:11.469 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj280 datafile 2020-02-08T18:22:11.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj281 datafile 2020-02-08T18:22:11.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj282 datafile 2020-02-08T18:22:11.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj283 datafile 2020-02-08T18:22:11.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj284 datafile 2020-02-08T18:22:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj285 datafile 2020-02-08T18:22:11.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj286 datafile 2020-02-08T18:22:11.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:11.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj287 datafile 2020-02-08T18:22:12.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj288 datafile 2020-02-08T18:22:12.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj289 datafile 2020-02-08T18:22:12.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj290 datafile 2020-02-08T18:22:12.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj291 datafile 2020-02-08T18:22:12.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj292 datafile 2020-02-08T18:22:12.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj293 datafile 2020-02-08T18:22:12.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj294 datafile 2020-02-08T18:22:12.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj295 datafile 2020-02-08T18:22:12.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj296 datafile 2020-02-08T18:22:12.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj297 datafile 2020-02-08T18:22:12.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj298 datafile 2020-02-08T18:22:12.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj299 datafile 2020-02-08T18:22:12.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:12.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj300 datafile 2020-02-08T18:22:13.056 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.056 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj301 datafile 2020-02-08T18:22:13.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj302 datafile 2020-02-08T18:22:13.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj303 datafile 2020-02-08T18:22:13.189 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj304 datafile 2020-02-08T18:22:13.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj305 datafile 2020-02-08T18:22:13.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj306 datafile 2020-02-08T18:22:13.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj307 datafile 2020-02-08T18:22:13.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj308 datafile 2020-02-08T18:22:13.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj309 datafile 2020-02-08T18:22:13.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.693 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj310 datafile 2020-02-08T18:22:13.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj311 datafile 2020-02-08T18:22:13.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj312 datafile 2020-02-08T18:22:13.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj313 datafile 2020-02-08T18:22:13.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:13.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj314 datafile 2020-02-08T18:22:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj315 datafile 2020-02-08T18:22:14.152 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.152 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj316 datafile 2020-02-08T18:22:14.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj317 datafile 2020-02-08T18:22:14.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj318 datafile 2020-02-08T18:22:14.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj319 datafile 2020-02-08T18:22:14.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj320 datafile 2020-02-08T18:22:14.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj321 datafile 2020-02-08T18:22:14.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj322 datafile 2020-02-08T18:22:14.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj323 datafile 2020-02-08T18:22:14.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj324 datafile 2020-02-08T18:22:14.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj325 datafile 2020-02-08T18:22:14.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj326 datafile 2020-02-08T18:22:14.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:14.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj327 datafile 2020-02-08T18:22:15.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj328 datafile 2020-02-08T18:22:15.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj329 datafile 2020-02-08T18:22:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj330 datafile 2020-02-08T18:22:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj331 datafile 2020-02-08T18:22:15.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj332 datafile 2020-02-08T18:22:15.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj333 datafile 2020-02-08T18:22:15.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj334 datafile 2020-02-08T18:22:15.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj335 datafile 2020-02-08T18:22:15.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj336 datafile 2020-02-08T18:22:15.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj337 datafile 2020-02-08T18:22:15.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj338 datafile 2020-02-08T18:22:15.740 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.740 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj339 datafile 2020-02-08T18:22:15.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj340 datafile 2020-02-08T18:22:15.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj341 datafile 2020-02-08T18:22:15.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj342 datafile 2020-02-08T18:22:15.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:15.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj343 datafile 2020-02-08T18:22:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj344 datafile 2020-02-08T18:22:16.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj345 datafile 2020-02-08T18:22:16.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj346 datafile 2020-02-08T18:22:16.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj347 datafile 2020-02-08T18:22:16.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj348 datafile 2020-02-08T18:22:16.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj349 datafile 2020-02-08T18:22:16.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj350 datafile 2020-02-08T18:22:16.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.582 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj351 datafile 2020-02-08T18:22:16.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj352 datafile 2020-02-08T18:22:16.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj353 datafile 2020-02-08T18:22:16.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj354 datafile 2020-02-08T18:22:16.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj355 datafile 2020-02-08T18:22:16.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:16.977 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj356 datafile 2020-02-08T18:22:17.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj357 datafile 2020-02-08T18:22:17.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj358 datafile 2020-02-08T18:22:17.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj359 datafile 2020-02-08T18:22:17.231 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj360 datafile 2020-02-08T18:22:17.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj361 datafile 2020-02-08T18:22:17.399 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.399 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj362 datafile 2020-02-08T18:22:17.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj363 datafile 2020-02-08T18:22:17.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj364 datafile 2020-02-08T18:22:17.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj365 datafile 2020-02-08T18:22:17.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj366 datafile 2020-02-08T18:22:17.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.829 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj367 datafile 2020-02-08T18:22:17.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.874 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj368 datafile 2020-02-08T18:22:17.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj369 datafile 2020-02-08T18:22:17.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:17.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj370 datafile 2020-02-08T18:22:18.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj371 datafile 2020-02-08T18:22:18.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj372 datafile 2020-02-08T18:22:18.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj373 datafile 2020-02-08T18:22:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj374 datafile 2020-02-08T18:22:18.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj375 datafile 2020-02-08T18:22:18.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj376 datafile 2020-02-08T18:22:18.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj377 datafile 2020-02-08T18:22:18.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj378 datafile 2020-02-08T18:22:18.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj379 datafile 2020-02-08T18:22:18.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj380 datafile 2020-02-08T18:22:18.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj381 datafile 2020-02-08T18:22:18.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj382 datafile 2020-02-08T18:22:18.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj383 datafile 2020-02-08T18:22:18.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.873 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj384 datafile 2020-02-08T18:22:18.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:18.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj385 datafile 2020-02-08T18:22:19.049 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.049 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj386 datafile 2020-02-08T18:22:19.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj387 datafile 2020-02-08T18:22:19.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj388 datafile 2020-02-08T18:22:19.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj389 datafile 2020-02-08T18:22:19.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj390 datafile 2020-02-08T18:22:19.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj391 datafile 2020-02-08T18:22:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj392 datafile 2020-02-08T18:22:19.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.545 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj393 datafile 2020-02-08T18:22:19.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj394 datafile 2020-02-08T18:22:19.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj395 datafile 2020-02-08T18:22:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj396 datafile 2020-02-08T18:22:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj397 datafile 2020-02-08T18:22:19.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj398 datafile 2020-02-08T18:22:19.978 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:19.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj399 datafile 2020-02-08T18:22:20.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj400 datafile 2020-02-08T18:22:20.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj401 datafile 2020-02-08T18:22:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj402 datafile 2020-02-08T18:22:20.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj403 datafile 2020-02-08T18:22:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj404 datafile 2020-02-08T18:22:20.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj405 datafile 2020-02-08T18:22:20.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj406 datafile 2020-02-08T18:22:20.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj407 datafile 2020-02-08T18:22:20.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj408 datafile 2020-02-08T18:22:20.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj409 datafile 2020-02-08T18:22:20.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj410 datafile 2020-02-08T18:22:20.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj411 datafile 2020-02-08T18:22:20.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:20.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj412 datafile 2020-02-08T18:22:21.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj413 datafile 2020-02-08T18:22:21.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj414 datafile 2020-02-08T18:22:21.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj415 datafile 2020-02-08T18:22:21.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj416 datafile 2020-02-08T18:22:21.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj417 datafile 2020-02-08T18:22:21.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj418 datafile 2020-02-08T18:22:21.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj419 datafile 2020-02-08T18:22:21.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj420 datafile 2020-02-08T18:22:21.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:21.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj421 datafile 2020-02-08T18:22:22.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj422 datafile 2020-02-08T18:22:22.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj423 datafile 2020-02-08T18:22:22.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj424 datafile 2020-02-08T18:22:22.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj425 datafile 2020-02-08T18:22:22.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj426 datafile 2020-02-08T18:22:22.664 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.664 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj427 datafile 2020-02-08T18:22:22.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj428 datafile 2020-02-08T18:22:22.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj429 datafile 2020-02-08T18:22:22.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj430 datafile 2020-02-08T18:22:22.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:22.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj431 datafile 2020-02-08T18:22:23.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj432 datafile 2020-02-08T18:22:23.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj433 datafile 2020-02-08T18:22:23.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj434 datafile 2020-02-08T18:22:23.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj435 datafile 2020-02-08T18:22:23.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj436 datafile 2020-02-08T18:22:23.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj437 datafile 2020-02-08T18:22:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.486 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj438 datafile 2020-02-08T18:22:23.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj439 datafile 2020-02-08T18:22:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj440 datafile 2020-02-08T18:22:23.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj441 datafile 2020-02-08T18:22:23.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj442 datafile 2020-02-08T18:22:23.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj443 datafile 2020-02-08T18:22:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj444 datafile 2020-02-08T18:22:23.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj445 datafile 2020-02-08T18:22:23.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:23.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj446 datafile 2020-02-08T18:22:24.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj447 datafile 2020-02-08T18:22:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj448 datafile 2020-02-08T18:22:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj449 datafile 2020-02-08T18:22:24.183 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj450 datafile 2020-02-08T18:22:24.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj451 datafile 2020-02-08T18:22:24.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj452 datafile 2020-02-08T18:22:24.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj453 datafile 2020-02-08T18:22:24.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj454 datafile 2020-02-08T18:22:24.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj455 datafile 2020-02-08T18:22:24.606 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.606 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj456 datafile 2020-02-08T18:22:24.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj457 datafile 2020-02-08T18:22:24.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj458 datafile 2020-02-08T18:22:24.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.801 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj459 datafile 2020-02-08T18:22:24.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj460 datafile 2020-02-08T18:22:24.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj461 datafile 2020-02-08T18:22:24.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:24.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj462 datafile 2020-02-08T18:22:25.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj463 datafile 2020-02-08T18:22:25.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj464 datafile 2020-02-08T18:22:25.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj465 datafile 2020-02-08T18:22:25.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj466 datafile 2020-02-08T18:22:25.330 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.330 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj467 datafile 2020-02-08T18:22:25.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj468 datafile 2020-02-08T18:22:25.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj469 datafile 2020-02-08T18:22:25.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj470 datafile 2020-02-08T18:22:25.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj471 datafile 2020-02-08T18:22:25.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj472 datafile 2020-02-08T18:22:25.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj473 datafile 2020-02-08T18:22:25.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj474 datafile 2020-02-08T18:22:25.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj475 datafile 2020-02-08T18:22:25.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:25.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj476 datafile 2020-02-08T18:22:26.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj477 datafile 2020-02-08T18:22:26.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.144 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj478 datafile 2020-02-08T18:22:26.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj479 datafile 2020-02-08T18:22:26.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj480 datafile 2020-02-08T18:22:26.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj481 datafile 2020-02-08T18:22:26.377 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj482 datafile 2020-02-08T18:22:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj483 datafile 2020-02-08T18:22:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj484 datafile 2020-02-08T18:22:26.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj485 datafile 2020-02-08T18:22:26.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj486 datafile 2020-02-08T18:22:26.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj487 datafile 2020-02-08T18:22:26.814 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj488 datafile 2020-02-08T18:22:26.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj489 datafile 2020-02-08T18:22:26.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj490 datafile 2020-02-08T18:22:26.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:26.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj491 datafile 2020-02-08T18:22:27.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj492 datafile 2020-02-08T18:22:27.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj493 datafile 2020-02-08T18:22:27.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj494 datafile 2020-02-08T18:22:27.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj495 datafile 2020-02-08T18:22:27.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj496 datafile 2020-02-08T18:22:27.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj497 datafile 2020-02-08T18:22:27.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj498 datafile 2020-02-08T18:22:27.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj499 datafile 2020-02-08T18:22:27.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj500 datafile 2020-02-08T18:22:27.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj501 datafile 2020-02-08T18:22:27.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj502 datafile 2020-02-08T18:22:27.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj503 datafile 2020-02-08T18:22:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.858 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj504 datafile 2020-02-08T18:22:27.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:27.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj505 datafile 2020-02-08T18:22:28.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj506 datafile 2020-02-08T18:22:28.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj507 datafile 2020-02-08T18:22:28.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj508 datafile 2020-02-08T18:22:28.259 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj509 datafile 2020-02-08T18:22:28.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj510 datafile 2020-02-08T18:22:28.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj511 datafile 2020-02-08T18:22:28.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj512 datafile 2020-02-08T18:22:28.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj513 datafile 2020-02-08T18:22:28.678 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj514 datafile 2020-02-08T18:22:28.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj515 datafile 2020-02-08T18:22:28.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.837 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj516 datafile 2020-02-08T18:22:28.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj517 datafile 2020-02-08T18:22:28.978 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:28.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj518 datafile 2020-02-08T18:22:29.071 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.071 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj519 datafile 2020-02-08T18:22:29.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj520 datafile 2020-02-08T18:22:29.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj521 datafile 2020-02-08T18:22:29.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj522 datafile 2020-02-08T18:22:29.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj523 datafile 2020-02-08T18:22:29.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj524 datafile 2020-02-08T18:22:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj525 datafile 2020-02-08T18:22:29.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj526 datafile 2020-02-08T18:22:29.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj527 datafile 2020-02-08T18:22:29.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj528 datafile 2020-02-08T18:22:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj529 datafile 2020-02-08T18:22:29.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj530 datafile 2020-02-08T18:22:29.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj531 datafile 2020-02-08T18:22:29.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:29.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj532 datafile 2020-02-08T18:22:30.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.022 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj533 datafile 2020-02-08T18:22:30.067 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.068 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj534 datafile 2020-02-08T18:22:30.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj535 datafile 2020-02-08T18:22:30.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj536 datafile 2020-02-08T18:22:30.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.242 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj537 datafile 2020-02-08T18:22:30.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj538 datafile 2020-02-08T18:22:30.376 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.376 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj539 datafile 2020-02-08T18:22:30.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj540 datafile 2020-02-08T18:22:30.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj541 datafile 2020-02-08T18:22:30.624 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.624 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj542 datafile 2020-02-08T18:22:30.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj543 datafile 2020-02-08T18:22:30.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj544 datafile 2020-02-08T18:22:30.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj545 datafile 2020-02-08T18:22:30.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:30.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj546 datafile 2020-02-08T18:22:31.051 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.051 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj547 datafile 2020-02-08T18:22:31.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj548 datafile 2020-02-08T18:22:31.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj549 datafile 2020-02-08T18:22:31.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj550 datafile 2020-02-08T18:22:31.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj551 datafile 2020-02-08T18:22:31.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj552 datafile 2020-02-08T18:22:31.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj553 datafile 2020-02-08T18:22:31.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj554 datafile 2020-02-08T18:22:31.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.619 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj555 datafile 2020-02-08T18:22:31.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj556 datafile 2020-02-08T18:22:31.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj557 datafile 2020-02-08T18:22:31.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:31.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj558 datafile 2020-02-08T18:22:32.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj559 datafile 2020-02-08T18:22:32.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj560 datafile 2020-02-08T18:22:32.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj561 datafile 2020-02-08T18:22:32.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj562 datafile 2020-02-08T18:22:32.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj563 datafile 2020-02-08T18:22:32.379 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.379 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj564 datafile 2020-02-08T18:22:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj565 datafile 2020-02-08T18:22:32.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj566 datafile 2020-02-08T18:22:32.560 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.560 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj567 datafile 2020-02-08T18:22:32.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj568 datafile 2020-02-08T18:22:32.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.687 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj569 datafile 2020-02-08T18:22:32.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj570 datafile 2020-02-08T18:22:32.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj571 datafile 2020-02-08T18:22:32.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj572 datafile 2020-02-08T18:22:32.977 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:32.977 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj573 datafile 2020-02-08T18:22:33.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj574 datafile 2020-02-08T18:22:33.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj575 datafile 2020-02-08T18:22:33.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj576 datafile 2020-02-08T18:22:33.340 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.341 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj577 datafile 2020-02-08T18:22:33.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj578 datafile 2020-02-08T18:22:33.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.474 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj579 datafile 2020-02-08T18:22:33.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj580 datafile 2020-02-08T18:22:33.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj581 datafile 2020-02-08T18:22:33.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj582 datafile 2020-02-08T18:22:33.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj583 datafile 2020-02-08T18:22:33.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj584 datafile 2020-02-08T18:22:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj585 datafile 2020-02-08T18:22:33.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:33.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj586 datafile 2020-02-08T18:22:34.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj587 datafile 2020-02-08T18:22:34.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj588 datafile 2020-02-08T18:22:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj589 datafile 2020-02-08T18:22:34.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj590 datafile 2020-02-08T18:22:34.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.308 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj591 datafile 2020-02-08T18:22:34.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj592 datafile 2020-02-08T18:22:34.393 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj593 datafile 2020-02-08T18:22:34.510 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.510 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj594 datafile 2020-02-08T18:22:34.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj595 datafile 2020-02-08T18:22:34.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj596 datafile 2020-02-08T18:22:34.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj597 datafile 2020-02-08T18:22:34.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.826 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj598 datafile 2020-02-08T18:22:34.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj599 datafile 2020-02-08T18:22:34.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:34.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj600 datafile 2020-02-08T18:22:35.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj601 datafile 2020-02-08T18:22:35.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj602 datafile 2020-02-08T18:22:35.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.152 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj603 datafile 2020-02-08T18:22:35.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj604 datafile 2020-02-08T18:22:35.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj605 datafile 2020-02-08T18:22:35.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj606 datafile 2020-02-08T18:22:35.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj607 datafile 2020-02-08T18:22:35.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.547 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj608 datafile 2020-02-08T18:22:35.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj609 datafile 2020-02-08T18:22:35.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj610 datafile 2020-02-08T18:22:35.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj611 datafile 2020-02-08T18:22:35.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj612 datafile 2020-02-08T18:22:35.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj613 datafile 2020-02-08T18:22:35.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:35.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj614 datafile 2020-02-08T18:22:36.027 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.027 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj615 datafile 2020-02-08T18:22:36.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj616 datafile 2020-02-08T18:22:36.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj617 datafile 2020-02-08T18:22:36.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj618 datafile 2020-02-08T18:22:36.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj619 datafile 2020-02-08T18:22:36.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj620 datafile 2020-02-08T18:22:36.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj621 datafile 2020-02-08T18:22:36.476 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.477 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj622 datafile 2020-02-08T18:22:36.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj623 datafile 2020-02-08T18:22:36.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj624 datafile 2020-02-08T18:22:36.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj625 datafile 2020-02-08T18:22:36.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj626 datafile 2020-02-08T18:22:36.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj627 datafile 2020-02-08T18:22:36.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:36.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj628 datafile 2020-02-08T18:22:37.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj629 datafile 2020-02-08T18:22:37.144 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.144 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj630 datafile 2020-02-08T18:22:37.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj631 datafile 2020-02-08T18:22:37.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj632 datafile 2020-02-08T18:22:37.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj633 datafile 2020-02-08T18:22:37.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj634 datafile 2020-02-08T18:22:37.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj635 datafile 2020-02-08T18:22:37.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj636 datafile 2020-02-08T18:22:37.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj637 datafile 2020-02-08T18:22:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.752 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj638 datafile 2020-02-08T18:22:37.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:37.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj639 datafile 2020-02-08T18:22:38.053 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj640 datafile 2020-02-08T18:22:38.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj641 datafile 2020-02-08T18:22:38.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj642 datafile 2020-02-08T18:22:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj643 datafile 2020-02-08T18:22:38.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj644 datafile 2020-02-08T18:22:38.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj645 datafile 2020-02-08T18:22:38.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj646 datafile 2020-02-08T18:22:38.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj647 datafile 2020-02-08T18:22:38.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj648 datafile 2020-02-08T18:22:38.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj649 datafile 2020-02-08T18:22:38.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj650 datafile 2020-02-08T18:22:38.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj651 datafile 2020-02-08T18:22:38.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj652 datafile 2020-02-08T18:22:38.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:38.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj653 datafile 2020-02-08T18:22:39.048 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.048 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj654 datafile 2020-02-08T18:22:39.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj655 datafile 2020-02-08T18:22:39.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj656 datafile 2020-02-08T18:22:39.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj657 datafile 2020-02-08T18:22:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj658 datafile 2020-02-08T18:22:39.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.483 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj659 datafile 2020-02-08T18:22:39.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj660 datafile 2020-02-08T18:22:39.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj661 datafile 2020-02-08T18:22:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj662 datafile 2020-02-08T18:22:39.702 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.702 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj663 datafile 2020-02-08T18:22:39.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj664 datafile 2020-02-08T18:22:39.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj665 datafile 2020-02-08T18:22:39.859 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.859 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj666 datafile 2020-02-08T18:22:39.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj667 datafile 2020-02-08T18:22:39.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:39.994 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj668 datafile 2020-02-08T18:22:40.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj669 datafile 2020-02-08T18:22:40.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj670 datafile 2020-02-08T18:22:40.234 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj671 datafile 2020-02-08T18:22:40.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj672 datafile 2020-02-08T18:22:40.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj673 datafile 2020-02-08T18:22:40.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj674 datafile 2020-02-08T18:22:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj675 datafile 2020-02-08T18:22:40.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj676 datafile 2020-02-08T18:22:40.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj677 datafile 2020-02-08T18:22:40.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj678 datafile 2020-02-08T18:22:40.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj679 datafile 2020-02-08T18:22:40.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:40.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj680 datafile 2020-02-08T18:22:41.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj681 datafile 2020-02-08T18:22:41.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj682 datafile 2020-02-08T18:22:41.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj683 datafile 2020-02-08T18:22:41.252 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.253 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj684 datafile 2020-02-08T18:22:41.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj685 datafile 2020-02-08T18:22:41.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj686 datafile 2020-02-08T18:22:41.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj687 datafile 2020-02-08T18:22:41.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj688 datafile 2020-02-08T18:22:41.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj689 datafile 2020-02-08T18:22:41.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj690 datafile 2020-02-08T18:22:41.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj691 datafile 2020-02-08T18:22:41.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj692 datafile 2020-02-08T18:22:41.828 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.828 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj693 datafile 2020-02-08T18:22:41.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:41.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj694 datafile 2020-02-08T18:22:42.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj695 datafile 2020-02-08T18:22:42.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj696 datafile 2020-02-08T18:22:42.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj697 datafile 2020-02-08T18:22:42.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj698 datafile 2020-02-08T18:22:42.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj699 datafile 2020-02-08T18:22:42.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj700 datafile 2020-02-08T18:22:42.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj701 datafile 2020-02-08T18:22:42.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj702 datafile 2020-02-08T18:22:42.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj703 datafile 2020-02-08T18:22:42.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj704 datafile 2020-02-08T18:22:42.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj705 datafile 2020-02-08T18:22:42.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj706 datafile 2020-02-08T18:22:42.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj707 datafile 2020-02-08T18:22:42.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:42.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj708 datafile 2020-02-08T18:22:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj709 datafile 2020-02-08T18:22:43.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj710 datafile 2020-02-08T18:22:43.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.244 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj711 datafile 2020-02-08T18:22:43.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj712 datafile 2020-02-08T18:22:43.384 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj713 datafile 2020-02-08T18:22:43.469 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.469 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj714 datafile 2020-02-08T18:22:43.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj715 datafile 2020-02-08T18:22:43.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj716 datafile 2020-02-08T18:22:43.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj717 datafile 2020-02-08T18:22:43.761 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.761 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj718 datafile 2020-02-08T18:22:43.809 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.810 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj719 datafile 2020-02-08T18:22:43.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj720 datafile 2020-02-08T18:22:43.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:43.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj721 datafile 2020-02-08T18:22:44.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj722 datafile 2020-02-08T18:22:44.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj723 datafile 2020-02-08T18:22:44.238 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.238 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj724 datafile 2020-02-08T18:22:44.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj725 datafile 2020-02-08T18:22:44.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj726 datafile 2020-02-08T18:22:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj727 datafile 2020-02-08T18:22:44.461 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.462 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj728 datafile 2020-02-08T18:22:44.555 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.555 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj729 datafile 2020-02-08T18:22:44.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj730 datafile 2020-02-08T18:22:44.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj731 datafile 2020-02-08T18:22:44.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj732 datafile 2020-02-08T18:22:44.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj733 datafile 2020-02-08T18:22:44.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:44.970 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj734 datafile 2020-02-08T18:22:45.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj735 datafile 2020-02-08T18:22:45.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.093 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj736 datafile 2020-02-08T18:22:45.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj737 datafile 2020-02-08T18:22:45.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj738 datafile 2020-02-08T18:22:45.245 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.245 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj739 datafile 2020-02-08T18:22:45.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj740 datafile 2020-02-08T18:22:45.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj741 datafile 2020-02-08T18:22:45.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj742 datafile 2020-02-08T18:22:45.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj743 datafile 2020-02-08T18:22:45.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj744 datafile 2020-02-08T18:22:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj745 datafile 2020-02-08T18:22:45.767 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.767 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj746 datafile 2020-02-08T18:22:45.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj747 datafile 2020-02-08T18:22:45.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj748 datafile 2020-02-08T18:22:45.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj749 datafile 2020-02-08T18:22:45.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:45.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj750 datafile 2020-02-08T18:22:46.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.012 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj751 datafile 2020-02-08T18:22:46.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj752 datafile 2020-02-08T18:22:46.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj753 datafile 2020-02-08T18:22:46.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj754 datafile 2020-02-08T18:22:46.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj755 datafile 2020-02-08T18:22:46.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj756 datafile 2020-02-08T18:22:46.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj757 datafile 2020-02-08T18:22:46.478 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.478 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj758 datafile 2020-02-08T18:22:46.520 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.520 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj759 datafile 2020-02-08T18:22:46.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj760 datafile 2020-02-08T18:22:46.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj761 datafile 2020-02-08T18:22:46.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.812 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj762 datafile 2020-02-08T18:22:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj763 datafile 2020-02-08T18:22:46.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:46.954 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj764 datafile 2020-02-08T18:22:47.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.046 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj765 datafile 2020-02-08T18:22:47.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.141 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj766 datafile 2020-02-08T18:22:47.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj767 datafile 2020-02-08T18:22:47.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj768 datafile 2020-02-08T18:22:47.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj769 datafile 2020-02-08T18:22:47.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.447 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj770 datafile 2020-02-08T18:22:47.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj771 datafile 2020-02-08T18:22:47.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj772 datafile 2020-02-08T18:22:47.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj773 datafile 2020-02-08T18:22:47.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj774 datafile 2020-02-08T18:22:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj775 datafile 2020-02-08T18:22:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj776 datafile 2020-02-08T18:22:47.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:47.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj777 datafile 2020-02-08T18:22:48.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj778 datafile 2020-02-08T18:22:48.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj779 datafile 2020-02-08T18:22:48.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj780 datafile 2020-02-08T18:22:48.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj781 datafile 2020-02-08T18:22:48.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj782 datafile 2020-02-08T18:22:48.421 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.421 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj783 datafile 2020-02-08T18:22:48.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj784 datafile 2020-02-08T18:22:48.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj785 datafile 2020-02-08T18:22:48.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj786 datafile 2020-02-08T18:22:48.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj787 datafile 2020-02-08T18:22:48.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.717 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj788 datafile 2020-02-08T18:22:48.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj789 datafile 2020-02-08T18:22:48.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj790 datafile 2020-02-08T18:22:48.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:48.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj791 datafile 2020-02-08T18:22:49.021 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.021 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj792 datafile 2020-02-08T18:22:49.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj793 datafile 2020-02-08T18:22:49.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj794 datafile 2020-02-08T18:22:49.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj795 datafile 2020-02-08T18:22:49.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj796 datafile 2020-02-08T18:22:49.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj797 datafile 2020-02-08T18:22:49.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj798 datafile 2020-02-08T18:22:49.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj799 datafile 2020-02-08T18:22:49.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj800 datafile 2020-02-08T18:22:49.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj801 datafile 2020-02-08T18:22:49.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj802 datafile 2020-02-08T18:22:49.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj803 datafile 2020-02-08T18:22:49.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj804 datafile 2020-02-08T18:22:49.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:49.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj805 datafile 2020-02-08T18:22:50.035 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.035 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj806 datafile 2020-02-08T18:22:50.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj807 datafile 2020-02-08T18:22:50.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj808 datafile 2020-02-08T18:22:50.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.288 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj809 datafile 2020-02-08T18:22:50.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj810 datafile 2020-02-08T18:22:50.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj811 datafile 2020-02-08T18:22:50.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj812 datafile 2020-02-08T18:22:50.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.588 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj813 datafile 2020-02-08T18:22:50.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj814 datafile 2020-02-08T18:22:50.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj815 datafile 2020-02-08T18:22:50.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj816 datafile 2020-02-08T18:22:50.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj817 datafile 2020-02-08T18:22:50.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:50.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj818 datafile 2020-02-08T18:22:51.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj819 datafile 2020-02-08T18:22:51.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj820 datafile 2020-02-08T18:22:51.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj821 datafile 2020-02-08T18:22:51.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj822 datafile 2020-02-08T18:22:51.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj823 datafile 2020-02-08T18:22:51.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.413 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj824 datafile 2020-02-08T18:22:51.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj825 datafile 2020-02-08T18:22:51.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj826 datafile 2020-02-08T18:22:51.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj827 datafile 2020-02-08T18:22:51.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj828 datafile 2020-02-08T18:22:51.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj829 datafile 2020-02-08T18:22:51.793 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj830 datafile 2020-02-08T18:22:51.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:51.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj831 datafile 2020-02-08T18:22:52.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.026 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj832 datafile 2020-02-08T18:22:52.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj833 datafile 2020-02-08T18:22:52.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj834 datafile 2020-02-08T18:22:52.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj835 datafile 2020-02-08T18:22:52.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj836 datafile 2020-02-08T18:22:52.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj837 datafile 2020-02-08T18:22:52.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj838 datafile 2020-02-08T18:22:52.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.486 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj839 datafile 2020-02-08T18:22:52.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj840 datafile 2020-02-08T18:22:52.606 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.607 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj841 datafile 2020-02-08T18:22:52.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj842 datafile 2020-02-08T18:22:52.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj843 datafile 2020-02-08T18:22:52.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj844 datafile 2020-02-08T18:22:52.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:52.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj845 datafile 2020-02-08T18:22:53.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:53.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj846 datafile 2020-02-08T18:22:53.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:53.088 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj847 datafile 2020-02-08T18:22:53.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:53.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj848 datafile 2020-02-08T18:22:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:53.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj849 datafile 2020-02-08T18:22:53.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:53.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj850 datafile 2020-02-08T18:22:53.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:53.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj851 datafile 2020-02-08T18:22:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj852 datafile 2020-02-08T18:22:54.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj853 datafile 2020-02-08T18:22:54.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj854 datafile 2020-02-08T18:22:54.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj855 datafile 2020-02-08T18:22:54.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj856 datafile 2020-02-08T18:22:54.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj857 datafile 2020-02-08T18:22:54.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj858 datafile 2020-02-08T18:22:54.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj859 datafile 2020-02-08T18:22:54.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj860 datafile 2020-02-08T18:22:54.874 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.874 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj861 datafile 2020-02-08T18:22:54.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:54.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj862 datafile 2020-02-08T18:22:55.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.017 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj863 datafile 2020-02-08T18:22:55.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj864 datafile 2020-02-08T18:22:55.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.189 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj865 datafile 2020-02-08T18:22:55.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj866 datafile 2020-02-08T18:22:55.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj867 datafile 2020-02-08T18:22:55.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj868 datafile 2020-02-08T18:22:55.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj869 datafile 2020-02-08T18:22:55.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj870 datafile 2020-02-08T18:22:55.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj871 datafile 2020-02-08T18:22:55.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj872 datafile 2020-02-08T18:22:55.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj873 datafile 2020-02-08T18:22:55.768 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.768 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj874 datafile 2020-02-08T18:22:55.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.814 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj875 datafile 2020-02-08T18:22:55.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:55.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj876 datafile 2020-02-08T18:22:56.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj877 datafile 2020-02-08T18:22:56.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj878 datafile 2020-02-08T18:22:56.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj879 datafile 2020-02-08T18:22:56.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.222 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj880 datafile 2020-02-08T18:22:56.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj881 datafile 2020-02-08T18:22:56.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj882 datafile 2020-02-08T18:22:56.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj883 datafile 2020-02-08T18:22:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj884 datafile 2020-02-08T18:22:56.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj885 datafile 2020-02-08T18:22:56.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj886 datafile 2020-02-08T18:22:56.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj887 datafile 2020-02-08T18:22:56.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj888 datafile 2020-02-08T18:22:56.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj889 datafile 2020-02-08T18:22:56.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:56.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj890 datafile 2020-02-08T18:22:57.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj891 datafile 2020-02-08T18:22:57.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj892 datafile 2020-02-08T18:22:57.239 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj893 datafile 2020-02-08T18:22:57.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj894 datafile 2020-02-08T18:22:57.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.399 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj895 datafile 2020-02-08T18:22:57.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj896 datafile 2020-02-08T18:22:57.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj897 datafile 2020-02-08T18:22:57.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj898 datafile 2020-02-08T18:22:57.606 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.607 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj899 datafile 2020-02-08T18:22:57.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj900 datafile 2020-02-08T18:22:57.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj901 datafile 2020-02-08T18:22:57.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj902 datafile 2020-02-08T18:22:57.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj903 datafile 2020-02-08T18:22:57.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:57.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj904 datafile 2020-02-08T18:22:58.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.092 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj905 datafile 2020-02-08T18:22:58.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj906 datafile 2020-02-08T18:22:58.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj907 datafile 2020-02-08T18:22:58.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj908 datafile 2020-02-08T18:22:58.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj909 datafile 2020-02-08T18:22:58.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj910 datafile 2020-02-08T18:22:58.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.510 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj911 datafile 2020-02-08T18:22:58.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj912 datafile 2020-02-08T18:22:58.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj913 datafile 2020-02-08T18:22:58.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj914 datafile 2020-02-08T18:22:58.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj915 datafile 2020-02-08T18:22:58.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj916 datafile 2020-02-08T18:22:58.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj917 datafile 2020-02-08T18:22:58.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:58.957 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj918 datafile 2020-02-08T18:22:59.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj919 datafile 2020-02-08T18:22:59.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj920 datafile 2020-02-08T18:22:59.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj921 datafile 2020-02-08T18:22:59.180 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj922 datafile 2020-02-08T18:22:59.303 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj923 datafile 2020-02-08T18:22:59.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.471 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj924 datafile 2020-02-08T18:22:59.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj925 datafile 2020-02-08T18:22:59.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj926 datafile 2020-02-08T18:22:59.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj927 datafile 2020-02-08T18:22:59.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj928 datafile 2020-02-08T18:22:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj929 datafile 2020-02-08T18:22:59.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.800 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj930 datafile 2020-02-08T18:22:59.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj931 datafile 2020-02-08T18:22:59.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj932 datafile 2020-02-08T18:22:59.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:22:59.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj933 datafile 2020-02-08T18:23:00.049 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.049 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj934 datafile 2020-02-08T18:23:00.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.140 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj935 datafile 2020-02-08T18:23:00.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj936 datafile 2020-02-08T18:23:00.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj937 datafile 2020-02-08T18:23:00.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj938 datafile 2020-02-08T18:23:00.415 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj939 datafile 2020-02-08T18:23:00.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj940 datafile 2020-02-08T18:23:00.607 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj941 datafile 2020-02-08T18:23:00.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj942 datafile 2020-02-08T18:23:00.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj943 datafile 2020-02-08T18:23:00.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj944 datafile 2020-02-08T18:23:00.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj945 datafile 2020-02-08T18:23:00.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj946 datafile 2020-02-08T18:23:00.958 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:00.958 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj947 datafile 2020-02-08T18:23:01.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj948 datafile 2020-02-08T18:23:01.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj949 datafile 2020-02-08T18:23:01.251 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.251 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj950 datafile 2020-02-08T18:23:01.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj951 datafile 2020-02-08T18:23:01.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj952 datafile 2020-02-08T18:23:01.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj953 datafile 2020-02-08T18:23:01.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj954 datafile 2020-02-08T18:23:01.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj955 datafile 2020-02-08T18:23:01.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj956 datafile 2020-02-08T18:23:01.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj957 datafile 2020-02-08T18:23:01.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.825 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj958 datafile 2020-02-08T18:23:01.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:01.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj959 datafile 2020-02-08T18:23:02.056 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.056 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj960 datafile 2020-02-08T18:23:02.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj961 datafile 2020-02-08T18:23:02.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj962 datafile 2020-02-08T18:23:02.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj963 datafile 2020-02-08T18:23:02.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj964 datafile 2020-02-08T18:23:02.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj965 datafile 2020-02-08T18:23:02.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj966 datafile 2020-02-08T18:23:02.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj967 datafile 2020-02-08T18:23:02.605 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.606 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj968 datafile 2020-02-08T18:23:02.697 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj969 datafile 2020-02-08T18:23:02.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.741 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj970 datafile 2020-02-08T18:23:02.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj971 datafile 2020-02-08T18:23:02.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:02.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj972 datafile 2020-02-08T18:23:03.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj973 datafile 2020-02-08T18:23:03.054 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.055 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj974 datafile 2020-02-08T18:23:03.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj975 datafile 2020-02-08T18:23:03.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj976 datafile 2020-02-08T18:23:03.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj977 datafile 2020-02-08T18:23:03.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj978 datafile 2020-02-08T18:23:03.341 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.341 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj979 datafile 2020-02-08T18:23:03.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj980 datafile 2020-02-08T18:23:03.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj981 datafile 2020-02-08T18:23:03.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj982 datafile 2020-02-08T18:23:03.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj983 datafile 2020-02-08T18:23:03.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj984 datafile 2020-02-08T18:23:03.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj985 datafile 2020-02-08T18:23:03.835 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.835 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj986 datafile 2020-02-08T18:23:03.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj987 datafile 2020-02-08T18:23:03.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:03.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj988 datafile 2020-02-08T18:23:04.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj989 datafile 2020-02-08T18:23:04.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.058 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj990 datafile 2020-02-08T18:23:04.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj991 datafile 2020-02-08T18:23:04.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj992 datafile 2020-02-08T18:23:04.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.217 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj993 datafile 2020-02-08T18:23:04.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj994 datafile 2020-02-08T18:23:04.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj995 datafile 2020-02-08T18:23:04.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj996 datafile 2020-02-08T18:23:04.469 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.470 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj997 datafile 2020-02-08T18:23:04.644 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.644 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj998 datafile 2020-02-08T18:23:04.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj999 datafile 2020-02-08T18:23:04.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:74: TEST_recover_unexpected: for j in $(seq 1 $OBJS) 2020-02-08T18:23:04.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:76: TEST_recover_unexpected: rados -p test3 put obj1000 datafile 2020-02-08T18:23:04.928 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:79: TEST_recover_unexpected: rm datafile 2020-02-08T18:23:04.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:81: TEST_recover_unexpected: ceph osd set noscrub 2020-02-08T18:23:05.306 INFO:tasks.workunit.client.0.smithi157.stderr:noscrub is set 2020-02-08T18:23:05.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:82: TEST_recover_unexpected: ceph osd set nodeep-scrub 2020-02-08T18:23:05.698 INFO:tasks.workunit.client.0.smithi157.stderr:nodeep-scrub is set 2020-02-08T18:23:05.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: ceph pg dump pgs --format=json-pretty 2020-02-08T18:23:05.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: jq '.pg_stats[].pgid' 2020-02-08T18:23:05.948 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:06.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:06.028 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:06.028 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.d") | .acting_primary' 2020-02-08T18:23:06.195 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:06.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:06.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.d"' 2020-02-08T18:23:06.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.d 2020-02-08T18:23:06.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.d scrub 2020-02-08T18:23:06.318 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:06.318 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:06.318 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:26.317433+0000" 2020-02-08T18:23:06.319 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:06.327 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:06.328 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:06.328 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.f") | .acting_primary' 2020-02-08T18:23:06.563 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:06.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:06.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.f"' 2020-02-08T18:23:06.573 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.f 2020-02-08T18:23:06.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.f scrub 2020-02-08T18:23:06.686 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:06.686 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:06.686 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:26.684835+0000" 2020-02-08T18:23:06.687 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:06.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:06.695 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:06.695 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.c") | .acting_primary' 2020-02-08T18:23:06.933 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:06.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=2 2020-02-08T18:23:06.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.c"' 2020-02-08T18:23:06.942 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.c 2020-02-08T18:23:06.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.c scrub 2020-02-08T18:23:07.055 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:07.055 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:07.055 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:27.054407+0000" 2020-02-08T18:23:07.056 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:07.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:07.065 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:07.065 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.c") | .acting_primary' 2020-02-08T18:23:07.304 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:07.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:07.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.c"' 2020-02-08T18:23:07.313 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.c 2020-02-08T18:23:07.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.c scrub 2020-02-08T18:23:07.425 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:07.425 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:07.425 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:27.424375+0000" 2020-02-08T18:23:07.426 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:07.434 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:07.435 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:07.435 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.e") | .acting_primary' 2020-02-08T18:23:07.671 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:07.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:07.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.e"' 2020-02-08T18:23:07.681 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.e 2020-02-08T18:23:07.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.e scrub 2020-02-08T18:23:07.793 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:07.794 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:07.794 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:27.792691+0000" 2020-02-08T18:23:07.794 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:07.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:07.803 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:07.803 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.d") | .acting_primary' 2020-02-08T18:23:08.041 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:08.050 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:08.050 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.d"' 2020-02-08T18:23:08.050 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.d 2020-02-08T18:23:08.051 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.d scrub 2020-02-08T18:23:08.163 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:08.163 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:08.163 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:28.162055+0000" 2020-02-08T18:23:08.163 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:08.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:08.173 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:08.173 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.f") | .acting_primary' 2020-02-08T18:23:08.410 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:08.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=0 2020-02-08T18:23:08.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.f"' 2020-02-08T18:23:08.419 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.f 2020-02-08T18:23:08.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.f scrub 2020-02-08T18:23:08.533 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:08.533 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:08.533 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:28.532495+0000" 2020-02-08T18:23:08.534 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:08.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:08.543 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:08.543 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.d") | .acting_primary' 2020-02-08T18:23:08.782 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:08.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=2 2020-02-08T18:23:08.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.d"' 2020-02-08T18:23:08.791 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.d 2020-02-08T18:23:08.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.d scrub 2020-02-08T18:23:08.903 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:08.903 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:08.903 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:28.901930+0000" 2020-02-08T18:23:08.903 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:08.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:08.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:08.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.e") | .acting_primary' 2020-02-08T18:23:09.157 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:09.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=2 2020-02-08T18:23:09.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.e"' 2020-02-08T18:23:09.162 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.e 2020-02-08T18:23:09.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.e scrub 2020-02-08T18:23:09.275 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:09.276 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:09.276 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:29.274693+0000" 2020-02-08T18:23:09.276 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:09.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:09.285 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:09.285 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.e") | .acting_primary' 2020-02-08T18:23:09.521 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:09.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=2 2020-02-08T18:23:09.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.e"' 2020-02-08T18:23:09.531 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.e 2020-02-08T18:23:09.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.e scrub 2020-02-08T18:23:09.643 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:09.643 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:09.643 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:29.642408+0000" 2020-02-08T18:23:09.644 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:09.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:09.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:09.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.c") | .acting_primary' 2020-02-08T18:23:09.890 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:09.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:09.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.c"' 2020-02-08T18:23:09.899 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.c 2020-02-08T18:23:09.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.c scrub 2020-02-08T18:23:10.011 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:10.011 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:10.012 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:30.010608+0000" 2020-02-08T18:23:10.012 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:10.020 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:10.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:10.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.f") | .acting_primary' 2020-02-08T18:23:10.258 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:10.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=0 2020-02-08T18:23:10.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.f"' 2020-02-08T18:23:10.268 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.f 2020-02-08T18:23:10.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.f scrub 2020-02-08T18:23:10.381 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:10.381 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:10.381 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:30.379948+0000" 2020-02-08T18:23:10.381 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:10.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:10.390 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:10.390 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.9") | .acting_primary' 2020-02-08T18:23:10.629 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:10.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:10.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.9"' 2020-02-08T18:23:10.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.9 2020-02-08T18:23:10.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.9 scrub 2020-02-08T18:23:10.750 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:10.751 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:10.751 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:30.749878+0000" 2020-02-08T18:23:10.751 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:10.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:10.760 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:10.760 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.b") | .acting_primary' 2020-02-08T18:23:10.997 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:11.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:11.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.b"' 2020-02-08T18:23:11.006 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.b 2020-02-08T18:23:11.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.b scrub 2020-02-08T18:23:11.118 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:11.119 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:11.119 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:31.117744+0000" 2020-02-08T18:23:11.119 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:11.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:11.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:11.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.8") | .acting_primary' 2020-02-08T18:23:11.381 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:11.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=0 2020-02-08T18:23:11.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.8"' 2020-02-08T18:23:11.391 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.8 2020-02-08T18:23:11.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.8 scrub 2020-02-08T18:23:11.505 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:11.505 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:11.505 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:31.502375+0000" 2020-02-08T18:23:11.505 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:11.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:11.513 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:11.513 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.8") | .acting_primary' 2020-02-08T18:23:11.748 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:11.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:11.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.8"' 2020-02-08T18:23:11.758 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.8 2020-02-08T18:23:11.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.8 scrub 2020-02-08T18:23:11.872 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:11.872 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:11.872 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:31.870934+0000" 2020-02-08T18:23:11.872 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:11.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:11.881 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:11.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.a") | .acting_primary' 2020-02-08T18:23:12.119 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:12.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:12.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.a"' 2020-02-08T18:23:12.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.a 2020-02-08T18:23:12.129 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.a scrub 2020-02-08T18:23:12.239 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:12.239 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:12.239 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:32.238387+0000" 2020-02-08T18:23:12.240 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:12.248 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:12.249 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:12.249 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.9") | .acting_primary' 2020-02-08T18:23:12.488 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:12.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:12.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.9"' 2020-02-08T18:23:12.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.9 2020-02-08T18:23:12.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.9 scrub 2020-02-08T18:23:12.609 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:12.610 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:12.610 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:32.608896+0000" 2020-02-08T18:23:12.610 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:12.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:12.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:12.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.b") | .acting_primary' 2020-02-08T18:23:12.856 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:12.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:12.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.b"' 2020-02-08T18:23:12.866 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.b 2020-02-08T18:23:12.866 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.b scrub 2020-02-08T18:23:12.978 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:12.978 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:12.978 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:32.977124+0000" 2020-02-08T18:23:12.979 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:12.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:12.987 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:12.987 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.9") | .acting_primary' 2020-02-08T18:23:13.224 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:13.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:13.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.9"' 2020-02-08T18:23:13.233 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.9 2020-02-08T18:23:13.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.9 scrub 2020-02-08T18:23:13.345 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:13.346 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:13.346 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:33.344518+0000" 2020-02-08T18:23:13.346 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:13.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:13.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:13.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.a") | .acting_primary' 2020-02-08T18:23:13.594 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:13.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:13.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.a"' 2020-02-08T18:23:13.601 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.a 2020-02-08T18:23:13.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.a scrub 2020-02-08T18:23:13.714 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:13.714 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:13.714 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:33.713211+0000" 2020-02-08T18:23:13.714 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:13.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:13.723 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:13.723 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.a") | .acting_primary' 2020-02-08T18:23:13.959 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:13.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:13.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.a"' 2020-02-08T18:23:13.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.a 2020-02-08T18:23:13.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.a scrub 2020-02-08T18:23:14.081 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:14.081 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:14.082 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:34.080330+0000" 2020-02-08T18:23:14.082 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:14.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:14.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:14.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.8") | .acting_primary' 2020-02-08T18:23:14.330 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:14.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:14.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.8"' 2020-02-08T18:23:14.339 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.8 2020-02-08T18:23:14.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.8 scrub 2020-02-08T18:23:14.451 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:14.451 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:14.451 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:34.450088+0000" 2020-02-08T18:23:14.451 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:14.459 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:14.460 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:14.461 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.b") | .acting_primary' 2020-02-08T18:23:14.698 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:14.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:14.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.b"' 2020-02-08T18:23:14.707 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.b 2020-02-08T18:23:14.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.b scrub 2020-02-08T18:23:14.822 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:14.822 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:14.822 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:34.821044+0000" 2020-02-08T18:23:14.822 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:14.830 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:14.831 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:14.831 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.5") | .acting_primary' 2020-02-08T18:23:15.068 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:15.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:15.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.5"' 2020-02-08T18:23:15.077 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.5 2020-02-08T18:23:15.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.5 scrub 2020-02-08T18:23:15.190 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:15.191 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:15.191 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:35.189547+0000" 2020-02-08T18:23:15.191 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:15.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:15.200 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:15.200 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.7") | .acting_primary' 2020-02-08T18:23:15.437 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:15.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:15.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.7"' 2020-02-08T18:23:15.446 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.7 2020-02-08T18:23:15.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.7 scrub 2020-02-08T18:23:15.560 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:15.560 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:15.560 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:35.559315+0000" 2020-02-08T18:23:15.560 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:15.568 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:15.569 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:15.570 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.4") | .acting_primary' 2020-02-08T18:23:15.807 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.4"' 2020-02-08T18:23:15.816 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.4 2020-02-08T18:23:15.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.4 scrub 2020-02-08T18:23:15.929 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:15.929 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:15.929 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:35.928217+0000" 2020-02-08T18:23:15.929 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:15.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:15.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:15.939 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.4") | .acting_primary' 2020-02-08T18:23:16.175 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:16.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:16.184 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.4"' 2020-02-08T18:23:16.184 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.4 2020-02-08T18:23:16.185 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.4 scrub 2020-02-08T18:23:16.296 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:16.296 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:16.296 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:36.295157+0000" 2020-02-08T18:23:16.297 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:16.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:16.306 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:16.306 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.6") | .acting_primary' 2020-02-08T18:23:16.543 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:16.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:16.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.6"' 2020-02-08T18:23:16.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.6 2020-02-08T18:23:16.553 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.6 scrub 2020-02-08T18:23:16.666 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:16.666 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:16.666 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:36.665519+0000" 2020-02-08T18:23:16.667 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:16.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:16.676 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:16.676 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.5") | .acting_primary' 2020-02-08T18:23:16.913 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:16.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:16.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.5"' 2020-02-08T18:23:16.923 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.5 2020-02-08T18:23:16.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.5 scrub 2020-02-08T18:23:17.036 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:17.036 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:17.036 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:37.034661+0000" 2020-02-08T18:23:17.037 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:17.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:17.045 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:17.046 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.1") | .acting_primary' 2020-02-08T18:23:17.280 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:17.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:17.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.1"' 2020-02-08T18:23:17.290 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.1 2020-02-08T18:23:17.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.1 scrub 2020-02-08T18:23:17.403 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:17.403 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:17.404 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:37.402519+0000" 2020-02-08T18:23:17.404 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:17.412 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:17.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:17.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.2") | .acting_primary' 2020-02-08T18:23:17.649 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:17.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:17.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.2"' 2020-02-08T18:23:17.659 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.2 2020-02-08T18:23:17.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.2 scrub 2020-02-08T18:23:17.770 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:17.770 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:17.770 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:37.769550+0000" 2020-02-08T18:23:17.771 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:17.779 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:17.780 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:17.780 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.3") | .acting_primary' 2020-02-08T18:23:18.018 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:18.027 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:18.027 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.3"' 2020-02-08T18:23:18.028 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.3 2020-02-08T18:23:18.028 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.3 scrub 2020-02-08T18:23:18.141 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:18.141 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:18.141 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:38.140043+0000" 2020-02-08T18:23:18.141 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:18.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:18.150 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:18.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.0") | .acting_primary' 2020-02-08T18:23:18.388 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:18.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:18.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.0"' 2020-02-08T18:23:18.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.0 2020-02-08T18:23:18.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.0 scrub 2020-02-08T18:23:18.510 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:18.510 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:18.510 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:38.509437+0000" 2020-02-08T18:23:18.511 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:18.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:18.520 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:18.520 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.3") | .acting_primary' 2020-02-08T18:23:18.764 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:18.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=5 2020-02-08T18:23:18.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.3"' 2020-02-08T18:23:18.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.3 2020-02-08T18:23:18.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.3 scrub 2020-02-08T18:23:18.885 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:18.885 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:18.885 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:38.884250+0000" 2020-02-08T18:23:18.885 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:18.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:18.894 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:18.894 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.2") | .acting_primary' 2020-02-08T18:23:19.134 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:19.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:19.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.2"' 2020-02-08T18:23:19.143 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.2 2020-02-08T18:23:19.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.2 scrub 2020-02-08T18:23:19.256 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:19.256 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:19.256 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:39.255006+0000" 2020-02-08T18:23:19.256 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:19.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:19.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:19.266 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.2") | .acting_primary' 2020-02-08T18:23:19.506 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:19.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=0 2020-02-08T18:23:19.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.2"' 2020-02-08T18:23:19.516 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.2 2020-02-08T18:23:19.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.2 scrub 2020-02-08T18:23:19.629 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:19.629 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:19.629 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:39.628056+0000" 2020-02-08T18:23:19.629 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:19.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:19.638 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:19.638 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.1") | .acting_primary' 2020-02-08T18:23:19.878 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:19.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=2 2020-02-08T18:23:19.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.1"' 2020-02-08T18:23:19.885 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.1 2020-02-08T18:23:19.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.1 scrub 2020-02-08T18:23:19.997 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:19.998 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:19.998 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:39.996807+0000" 2020-02-08T18:23:19.998 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:20.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:20.014 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:20.015 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.0") | .acting_primary' 2020-02-08T18:23:20.245 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:20.253 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:20.253 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.0"' 2020-02-08T18:23:20.253 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.0 2020-02-08T18:23:20.254 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.0 scrub 2020-02-08T18:23:20.365 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:20.365 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:20.365 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:40.363944+0000" 2020-02-08T18:23:20.366 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:20.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:20.374 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:20.375 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.3") | .acting_primary' 2020-02-08T18:23:20.614 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:20.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.3"' 2020-02-08T18:23:20.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.3 2020-02-08T18:23:20.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.3 scrub 2020-02-08T18:23:20.737 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:20.737 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:20.737 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:40.735837+0000" 2020-02-08T18:23:20.737 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:20.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:20.746 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:20.746 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.0") | .acting_primary' 2020-02-08T18:23:20.983 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:20.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:20.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.0"' 2020-02-08T18:23:20.993 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.0 2020-02-08T18:23:20.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.0 scrub 2020-02-08T18:23:21.105 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:21.105 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:21.106 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:41.103931+0000" 2020-02-08T18:23:21.106 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:21.113 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:21.114 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:21.114 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.1") | .acting_primary' 2020-02-08T18:23:21.378 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:21.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:21.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.1"' 2020-02-08T18:23:21.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.1 2020-02-08T18:23:21.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.1 scrub 2020-02-08T18:23:21.500 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:21.501 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:21.501 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:41.499734+0000" 2020-02-08T18:23:21.501 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:21.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:21.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:21.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.6") | .acting_primary' 2020-02-08T18:23:21.751 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:21.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=0 2020-02-08T18:23:21.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.6"' 2020-02-08T18:23:21.760 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.6 2020-02-08T18:23:21.760 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.6 scrub 2020-02-08T18:23:21.873 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:21.874 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:21.874 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:41.872723+0000" 2020-02-08T18:23:21.874 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:21.883 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:21.883 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.4") | .acting_primary' 2020-02-08T18:23:22.122 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.4"' 2020-02-08T18:23:22.132 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.4 2020-02-08T18:23:22.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.4 scrub 2020-02-08T18:23:22.243 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:22.243 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:22.244 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:42.242261+0000" 2020-02-08T18:23:22.244 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:22.253 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:22.253 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:22.253 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.7") | .acting_primary' 2020-02-08T18:23:22.492 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:22.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=3 2020-02-08T18:23:22.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.7"' 2020-02-08T18:23:22.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.7 2020-02-08T18:23:22.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.7 scrub 2020-02-08T18:23:22.613 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:22.613 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:22.614 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:42.612588+0000" 2020-02-08T18:23:22.614 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:22.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:22.623 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:22.623 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "3.7") | .acting_primary' 2020-02-08T18:23:22.859 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:22.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:22.868 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="3.7"' 2020-02-08T18:23:22.869 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=3.7 2020-02-08T18:23:22.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 3.7 scrub 2020-02-08T18:23:22.980 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:22.980 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:22.981 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:42.979489+0000" 2020-02-08T18:23:22.981 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:22.989 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:22.990 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:22.990 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "1.5") | .acting_primary' 2020-02-08T18:23:23.231 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=4 2020-02-08T18:23:23.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="1.5"' 2020-02-08T18:23:23.241 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=1.5 2020-02-08T18:23:23.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 1.5 scrub 2020-02-08T18:23:23.354 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:23.354 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:23.355 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:43.353531+0000" 2020-02-08T18:23:23.355 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:23.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:84: TEST_recover_unexpected: for qpg in $(ceph pg dump pgs --format=json-pretty | jq '.pg_stats[].pgid') 2020-02-08T18:23:23.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: ceph pg dump pgs --format=json 2020-02-08T18:23:23.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: jq '.pg_stats[] | select(.pgid == "2.6") | .acting_primary' 2020-02-08T18:23:23.601 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:23.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: TEST_recover_unexpected: primary=1 2020-02-08T18:23:23.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: eval 'pg="2.6"' 2020-02-08T18:23:23.610 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: TEST_recover_unexpected: pg=2.6 2020-02-08T18:23:23.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: TEST_recover_unexpected: ceph tell 2.6 scrub 2020-02-08T18:23:23.724 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:23.724 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:23:23.724 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:21:43.723097+0000" 2020-02-08T18:23:23.724 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:23.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:91: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:23.964 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:23:23.964 INFO:tasks.workunit.client.0.smithi157.stdout:3.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.535989+0000 46'67 48:82 [3,1,0] 3 [3,1,0] 3 0'0 2020-02-01T18:21:26.317433+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.965 INFO:tasks.workunit.client.0.smithi157.stdout:1.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:23.270633+0000 46'62 48:86 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:26.684835+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.965 INFO:tasks.workunit.client.0.smithi157.stdout:2.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:24.642183+0000 46'60 48:78 [2,0,5] 2 [2,0,5] 2 0'0 2020-02-01T18:21:27.054407+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.965 INFO:tasks.workunit.client.0.smithi157.stdout:3.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:26.370718+0000 46'60 48:73 [5,3,1] 5 [5,3,1] 5 0'0 2020-02-01T18:21:27.424375+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.965 INFO:tasks.workunit.client.0.smithi157.stdout:1.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:23.272587+0000 46'69 48:92 [1,4,2] 1 [1,4,2] 1 0'0 2020-02-01T18:21:27.792691+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.965 INFO:tasks.workunit.client.0.smithi157.stdout:2.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.560132+0000 46'67 48:84 [5,1,3] 5 [5,1,3] 5 0'0 2020-02-01T18:21:28.162055+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.965 INFO:tasks.workunit.client.0.smithi157.stdout:3.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:26.370499+0000 46'62 48:76 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:28.532495+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:1.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.271128+0000 46'67 48:88 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:28.901930+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:2.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:24.642240+0000 46'69 48:87 [2,3,5] 2 [2,3,5] 2 0'0 2020-02-01T18:21:29.274693+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:3.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:26.432403+0000 46'69 48:83 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:29.642408+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:1.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:23.270499+0000 46'60 48:84 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:30.010608+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:2.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:24.560134+0000 46'62 48:80 [0,5,4] 0 [0,5,4] 0 0'0 2020-02-01T18:21:30.379948+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:3.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.319069+0000 46'61 48:76 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:30.749878+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.966 INFO:tasks.workunit.client.0.smithi157.stdout:1.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:23.155413+0000 46'65 48:88 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:31.117744+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:2.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:24.479809+0000 46'66 48:84 [0,2,1] 0 [0,2,1] 0 0'0 2020-02-01T18:21:31.502375+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:3.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:26.292381+0000 46'66 48:81 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:31.870934+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:1.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.270241+0000 46'61 48:84 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:32.238387+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:2.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:25.027662+0000 46'61 48:80 [4,1,0] 4 [4,1,0] 4 0'0 2020-02-01T18:21:32.608896+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:3.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:26.535834+0000 46'65 48:80 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:32.977124+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:1.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.272335+0000 46'61 48:84 [1,4,5] 1 [1,4,5] 1 0'0 2020-02-01T18:21:33.344518+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:2.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:24.479833+0000 46'61 48:79 [1,5,0] 1 [1,5,0] 1 0'0 2020-02-01T18:21:33.713211+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.967 INFO:tasks.workunit.client.0.smithi157.stdout:3.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.370557+0000 46'61 48:76 [3,1,5] 3 [3,1,5] 3 0'0 2020-02-01T18:21:34.080330+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:1.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:23.269806+0000 46'66 48:88 [5,4,3] 5 [5,4,3] 5 0'0 2020-02-01T18:21:34.450088+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:2.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:24.913254+0000 46'65 48:85 [3,2,5] 3 [3,2,5] 3 0'0 2020-02-01T18:21:34.821044+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:3.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:26.432347+0000 46'73 48:86 [5,3,4] 5 [5,3,4] 5 0'0 2020-02-01T18:21:35.189547+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:1.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:23.155495+0000 46'53 48:76 [1,3,0] 1 [1,3,0] 1 0'0 2020-02-01T18:21:35.559315+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:2.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:24.522195+0000 46'51 48:69 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:35.928217+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:3.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:26.503781+0000 46'51 48:65 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:36.295157+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.968 INFO:tasks.workunit.client.0.smithi157.stdout:1.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:23.269659+0000 46'64 48:88 [3,4,2] 3 [3,4,2] 3 0'0 2020-02-01T18:21:36.665519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:2.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:25.027062+0000 46'73 48:93 [3,4,0] 3 [3,4,0] 3 0'0 2020-02-01T18:21:37.034661+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:1.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.269581+0000 46'67 48:89 [5,0,4] 5 [5,0,4] 5 0'0 2020-02-01T18:21:37.402519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:2.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:24.479931+0000 46'55 48:72 [5,1,0] 5 [5,1,0] 5 0'0 2020-02-01T18:21:37.769550+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:3.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:26.292648+0000 46'54 48:69 [4,0,5] 4 [4,0,5] 4 0'0 2020-02-01T18:21:38.140043+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:23.155746+0000 46'72 48:95 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:38.509437+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:2.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:24.523414+0000 46'54 48:71 [5,4,1] 5 [5,4,1] 5 0'0 2020-02-01T18:21:38.884250+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.969 INFO:tasks.workunit.client.0.smithi157.stdout:3.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:26.535894+0000 46'55 47:69 [3,5,0] 3 [3,5,0] 3 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.971 INFO:tasks.workunit.client.0.smithi157.stdout:1.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:23.271090+0000 46'55 48:76 [0,4,1] 0 [0,4,1] 0 0'0 2020-02-01T18:21:39.628056+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.971 INFO:tasks.workunit.client.0.smithi157.stdout:2.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.642179+0000 46'67 48:85 [2,5,0] 2 [2,5,0] 2 0'0 2020-02-01T18:21:39.996807+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.971 INFO:tasks.workunit.client.0.smithi157.stdout:3.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:26.504190+0000 46'72 47:85 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.971 INFO:tasks.workunit.client.0.smithi157.stdout:1.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:23.269511+0000 46'54 47:75 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.971 INFO:tasks.workunit.client.0.smithi157.stdout:2.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:24.977425+0000 46'72 47:91 [3,5,1] 3 [3,5,1] 3 0'0 2020-02-08T18:19:23.885301+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.971 INFO:tasks.workunit.client.0.smithi157.stdout:3.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.290988+0000 46'67 47:81 [4,3,5] 4 [4,3,5] 4 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout:3.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:26.332129+0000 46'64 48:78 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:41.872723+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout:1.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:23.202933+0000 46'51 47:74 [3,0,1] 3 [3,0,1] 3 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout:2.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:25.027223+0000 46'53 47:72 [3,0,2] 3 [3,0,2] 3 0'0 2020-02-08T18:19:23.885301+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout:3.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:26.259977+0000 46'53 47:67 [4,3,0] 4 [4,3,0] 4 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout:1.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:23.311089+0000 46'73 47:94 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout:2.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:24.522559+0000 46'64 47:81 [1,0,4] 1 [1,0,4] 1 0'0 2020-02-08T18:19:23.885301+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:23.972 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:23:23.973 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:23:23.973 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:23.975 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:93: TEST_recover_unexpected: jq .osd_max_scrubs 2020-02-08T18:23:23.975 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:93: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:23.975 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:23.976 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:23.976 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:23.977 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:23.977 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:23.977 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:23.977 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:93: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:23.977 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:93: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:24.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:93: TEST_recover_unexpected: max=4 2020-02-08T18:23:24.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:94: TEST_recover_unexpected: '[' 4 '!=' '4]' 2020-02-08T18:23:24.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh: line 94: [: missing `]' 2020-02-08T18:23:24.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:100: TEST_recover_unexpected: ceph osd unset noscrub 2020-02-08T18:23:24.428 INFO:tasks.workunit.client.0.smithi157.stderr:noscrub is unset 2020-02-08T18:23:24.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:102: TEST_recover_unexpected: ok=false 2020-02-08T18:23:24.436 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:103: TEST_recover_unexpected: seq 0 300 2020-02-08T18:23:24.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:103: TEST_recover_unexpected: for i in $(seq 0 300) 2020-02-08T18:23:24.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:105: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:24.675 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:23:24.676 INFO:tasks.workunit.client.0.smithi157.stdout:3.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.535989+0000 46'67 48:82 [3,1,0] 3 [3,1,0] 3 0'0 2020-02-01T18:21:26.317433+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.676 INFO:tasks.workunit.client.0.smithi157.stdout:1.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:23.270633+0000 46'62 48:86 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:26.684835+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.676 INFO:tasks.workunit.client.0.smithi157.stdout:2.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:24.642183+0000 46'60 48:78 [2,0,5] 2 [2,0,5] 2 0'0 2020-02-01T18:21:27.054407+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.676 INFO:tasks.workunit.client.0.smithi157.stdout:3.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:26.370718+0000 46'60 48:73 [5,3,1] 5 [5,3,1] 5 0'0 2020-02-01T18:21:27.424375+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.677 INFO:tasks.workunit.client.0.smithi157.stdout:1.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:23.272587+0000 46'69 48:92 [1,4,2] 1 [1,4,2] 1 0'0 2020-02-01T18:21:27.792691+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.677 INFO:tasks.workunit.client.0.smithi157.stdout:2.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.560132+0000 46'67 48:84 [5,1,3] 5 [5,1,3] 5 0'0 2020-02-01T18:21:28.162055+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.677 INFO:tasks.workunit.client.0.smithi157.stdout:3.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:26.370499+0000 46'62 48:76 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:28.532495+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.677 INFO:tasks.workunit.client.0.smithi157.stdout:1.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.271128+0000 46'67 48:88 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:28.901930+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.678 INFO:tasks.workunit.client.0.smithi157.stdout:2.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:24.642240+0000 46'69 48:87 [2,3,5] 2 [2,3,5] 2 0'0 2020-02-01T18:21:29.274693+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.678 INFO:tasks.workunit.client.0.smithi157.stdout:3.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:26.432403+0000 46'69 48:83 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:29.642408+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.678 INFO:tasks.workunit.client.0.smithi157.stdout:1.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:23.270499+0000 46'60 48:84 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:30.010608+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.678 INFO:tasks.workunit.client.0.smithi157.stdout:2.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:24.560134+0000 46'62 48:80 [0,5,4] 0 [0,5,4] 0 0'0 2020-02-01T18:21:30.379948+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.679 INFO:tasks.workunit.client.0.smithi157.stdout:3.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.319069+0000 46'61 48:76 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:30.749878+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.679 INFO:tasks.workunit.client.0.smithi157.stdout:1.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:23.155413+0000 46'65 48:88 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:31.117744+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.679 INFO:tasks.workunit.client.0.smithi157.stdout:2.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:24.479809+0000 46'66 48:84 [0,2,1] 0 [0,2,1] 0 0'0 2020-02-01T18:21:31.502375+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.679 INFO:tasks.workunit.client.0.smithi157.stdout:3.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:26.292381+0000 46'66 48:81 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:31.870934+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.679 INFO:tasks.workunit.client.0.smithi157.stdout:1.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.270241+0000 46'61 48:84 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:32.238387+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.679 INFO:tasks.workunit.client.0.smithi157.stdout:2.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:25.027662+0000 46'61 48:80 [4,1,0] 4 [4,1,0] 4 0'0 2020-02-01T18:21:32.608896+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.680 INFO:tasks.workunit.client.0.smithi157.stdout:3.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:26.535834+0000 46'65 48:80 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:32.977124+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.680 INFO:tasks.workunit.client.0.smithi157.stdout:1.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.272335+0000 46'61 48:84 [1,4,5] 1 [1,4,5] 1 0'0 2020-02-01T18:21:33.344518+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.680 INFO:tasks.workunit.client.0.smithi157.stdout:2.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:24.479833+0000 46'61 48:79 [1,5,0] 1 [1,5,0] 1 0'0 2020-02-01T18:21:33.713211+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.680 INFO:tasks.workunit.client.0.smithi157.stdout:3.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.370557+0000 46'61 48:76 [3,1,5] 3 [3,1,5] 3 0'0 2020-02-01T18:21:34.080330+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.680 INFO:tasks.workunit.client.0.smithi157.stdout:1.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:23.269806+0000 46'66 48:88 [5,4,3] 5 [5,4,3] 5 0'0 2020-02-01T18:21:34.450088+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.681 INFO:tasks.workunit.client.0.smithi157.stdout:2.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:24.913254+0000 46'65 48:85 [3,2,5] 3 [3,2,5] 3 0'0 2020-02-01T18:21:34.821044+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.681 INFO:tasks.workunit.client.0.smithi157.stdout:3.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:26.432347+0000 46'73 48:86 [5,3,4] 5 [5,3,4] 5 0'0 2020-02-01T18:21:35.189547+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.681 INFO:tasks.workunit.client.0.smithi157.stdout:1.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:23.155495+0000 46'53 48:76 [1,3,0] 1 [1,3,0] 1 0'0 2020-02-01T18:21:35.559315+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.681 INFO:tasks.workunit.client.0.smithi157.stdout:2.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:24.522195+0000 46'51 48:69 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:35.928217+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.684 INFO:tasks.workunit.client.0.smithi157.stdout:3.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:26.503781+0000 46'51 48:65 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:36.295157+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.684 INFO:tasks.workunit.client.0.smithi157.stdout:1.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:23.269659+0000 46'64 48:88 [3,4,2] 3 [3,4,2] 3 0'0 2020-02-01T18:21:36.665519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.684 INFO:tasks.workunit.client.0.smithi157.stdout:2.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:25.027062+0000 46'73 48:93 [3,4,0] 3 [3,4,0] 3 0'0 2020-02-01T18:21:37.034661+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.684 INFO:tasks.workunit.client.0.smithi157.stdout:1.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.269581+0000 46'67 48:89 [5,0,4] 5 [5,0,4] 5 0'0 2020-02-01T18:21:37.402519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.684 INFO:tasks.workunit.client.0.smithi157.stdout:2.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:24.479931+0000 46'55 48:72 [5,1,0] 5 [5,1,0] 5 0'0 2020-02-01T18:21:37.769550+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.685 INFO:tasks.workunit.client.0.smithi157.stdout:3.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:26.292648+0000 46'54 48:69 [4,0,5] 4 [4,0,5] 4 0'0 2020-02-01T18:21:38.140043+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.685 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:23.155746+0000 46'72 48:95 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:38.509437+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.685 INFO:tasks.workunit.client.0.smithi157.stdout:2.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:24.523414+0000 46'54 48:71 [5,4,1] 5 [5,4,1] 5 0'0 2020-02-01T18:21:38.884250+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.685 INFO:tasks.workunit.client.0.smithi157.stdout:3.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:26.535894+0000 46'55 48:70 [3,5,0] 3 [3,5,0] 3 0'0 2020-02-01T18:21:39.255006+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.685 INFO:tasks.workunit.client.0.smithi157.stdout:1.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:23.271090+0000 46'55 48:76 [0,4,1] 0 [0,4,1] 0 0'0 2020-02-01T18:21:39.628056+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.685 INFO:tasks.workunit.client.0.smithi157.stdout:2.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.642179+0000 46'67 48:85 [2,5,0] 2 [2,5,0] 2 0'0 2020-02-01T18:21:39.996807+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.686 INFO:tasks.workunit.client.0.smithi157.stdout:3.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:26.504190+0000 46'72 48:86 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:40.363944+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.686 INFO:tasks.workunit.client.0.smithi157.stdout:1.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:23.269511+0000 46'54 47:75 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.686 INFO:tasks.workunit.client.0.smithi157.stdout:2.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:24.977425+0000 46'72 48:92 [3,5,1] 3 [3,5,1] 3 0'0 2020-02-01T18:21:41.103931+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.686 INFO:tasks.workunit.client.0.smithi157.stdout:3.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.290988+0000 46'67 47:81 [4,3,5] 4 [4,3,5] 4 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.686 INFO:tasks.workunit.client.0.smithi157.stdout:3.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:26.332129+0000 46'64 48:78 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:41.872723+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.686 INFO:tasks.workunit.client.0.smithi157.stdout:1.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:23.202933+0000 46'51 48:75 [3,0,1] 3 [3,0,1] 3 0'0 2020-02-01T18:21:42.242261+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.687 INFO:tasks.workunit.client.0.smithi157.stdout:2.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:25.027223+0000 46'53 48:73 [3,0,2] 3 [3,0,2] 3 0'0 2020-02-01T18:21:42.612588+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.687 INFO:tasks.workunit.client.0.smithi157.stdout:3.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:26.259977+0000 46'53 47:67 [4,3,0] 4 [4,3,0] 4 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:24.687 INFO:tasks.workunit.client.0.smithi157.stdout:1.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:23.311089+0000 46'73 47:94 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:24.687 INFO:tasks.workunit.client.0.smithi157.stdout:2.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:24.522559+0000 46'64 48:82 [1,0,4] 1 [1,0,4] 1 0'0 2020-02-01T18:21:43.723097+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:24.687 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:23:24.687 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:23:24.688 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:24.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:24.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:23:24.922 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:24.930 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:110: TEST_recover_unexpected: sleep 1 2020-02-08T18:23:25.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:103: TEST_recover_unexpected: for i in $(seq 0 300) 2020-02-08T18:23:25.931 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:105: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:26.176 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:23:26.176 INFO:tasks.workunit.client.0.smithi157.stdout:3.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.535989+0000 46'67 48:82 [3,1,0] 3 [3,1,0] 3 0'0 2020-02-01T18:21:26.317433+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:1.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:23.270633+0000 46'62 48:86 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:26.684835+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:2.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:24.642183+0000 46'60 48:78 [2,0,5] 2 [2,0,5] 2 0'0 2020-02-01T18:21:27.054407+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:3.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:26.370718+0000 46'60 48:73 [5,3,1] 5 [5,3,1] 5 0'0 2020-02-01T18:21:27.424375+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:1.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:23.272587+0000 46'69 48:92 [1,4,2] 1 [1,4,2] 1 0'0 2020-02-01T18:21:27.792691+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:2.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.560132+0000 46'67 48:84 [5,1,3] 5 [5,1,3] 5 0'0 2020-02-01T18:21:28.162055+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:3.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:26.370499+0000 46'62 48:76 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:28.532495+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.177 INFO:tasks.workunit.client.0.smithi157.stdout:1.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.271128+0000 46'67 48:88 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:28.901930+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:2.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:24.642240+0000 46'69 48:87 [2,3,5] 2 [2,3,5] 2 0'0 2020-02-01T18:21:29.274693+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:3.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:26.432403+0000 46'69 48:83 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:29.642408+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:1.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:23.270499+0000 46'60 48:84 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:30.010608+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:2.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:24.560134+0000 46'62 48:80 [0,5,4] 0 [0,5,4] 0 0'0 2020-02-01T18:21:30.379948+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:3.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.319069+0000 46'61 48:76 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:30.749878+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:1.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:23.155413+0000 46'65 48:88 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:31.117744+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.178 INFO:tasks.workunit.client.0.smithi157.stdout:2.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:24.479809+0000 46'66 48:84 [0,2,1] 0 [0,2,1] 0 0'0 2020-02-01T18:21:31.502375+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:3.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:26.292381+0000 46'66 48:81 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:31.870934+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:1.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.270241+0000 46'61 48:84 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:32.238387+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:2.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:25.027662+0000 46'61 48:80 [4,1,0] 4 [4,1,0] 4 0'0 2020-02-01T18:21:32.608896+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:3.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:26.535834+0000 46'65 48:80 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:32.977124+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:1.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.272335+0000 46'61 48:84 [1,4,5] 1 [1,4,5] 1 0'0 2020-02-01T18:21:33.344518+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:2.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:24.479833+0000 46'61 48:79 [1,5,0] 1 [1,5,0] 1 0'0 2020-02-01T18:21:33.713211+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.179 INFO:tasks.workunit.client.0.smithi157.stdout:3.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.370557+0000 46'61 48:76 [3,1,5] 3 [3,1,5] 3 0'0 2020-02-01T18:21:34.080330+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.180 INFO:tasks.workunit.client.0.smithi157.stdout:1.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:23.269806+0000 46'66 48:88 [5,4,3] 5 [5,4,3] 5 0'0 2020-02-01T18:21:34.450088+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.180 INFO:tasks.workunit.client.0.smithi157.stdout:2.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:24.913254+0000 46'65 48:85 [3,2,5] 3 [3,2,5] 3 0'0 2020-02-01T18:21:34.821044+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.180 INFO:tasks.workunit.client.0.smithi157.stdout:3.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:26.432347+0000 46'73 48:86 [5,3,4] 5 [5,3,4] 5 0'0 2020-02-01T18:21:35.189547+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.180 INFO:tasks.workunit.client.0.smithi157.stdout:1.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:23.155495+0000 46'53 48:76 [1,3,0] 1 [1,3,0] 1 0'0 2020-02-01T18:21:35.559315+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.180 INFO:tasks.workunit.client.0.smithi157.stdout:2.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:24.522195+0000 46'51 48:69 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:35.928217+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:3.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:26.503781+0000 46'51 48:65 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:36.295157+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:1.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:23.269659+0000 46'64 48:88 [3,4,2] 3 [3,4,2] 3 0'0 2020-02-01T18:21:36.665519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:2.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:25.027062+0000 46'73 48:93 [3,4,0] 3 [3,4,0] 3 0'0 2020-02-01T18:21:37.034661+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:1.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.269581+0000 46'67 48:89 [5,0,4] 5 [5,0,4] 5 0'0 2020-02-01T18:21:37.402519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:2.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:24.479931+0000 46'55 48:72 [5,1,0] 5 [5,1,0] 5 0'0 2020-02-01T18:21:37.769550+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:3.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:26.292648+0000 46'54 48:69 [4,0,5] 4 [4,0,5] 4 0'0 2020-02-01T18:21:38.140043+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.181 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:23.155746+0000 46'72 48:95 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:38.509437+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:2.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:24.523414+0000 46'54 48:71 [5,4,1] 5 [5,4,1] 5 0'0 2020-02-01T18:21:38.884250+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:3.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:26.535894+0000 46'55 48:70 [3,5,0] 3 [3,5,0] 3 0'0 2020-02-01T18:21:39.255006+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:1.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:23.271090+0000 46'55 48:76 [0,4,1] 0 [0,4,1] 0 0'0 2020-02-01T18:21:39.628056+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:2.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.642179+0000 46'67 48:85 [2,5,0] 2 [2,5,0] 2 0'0 2020-02-01T18:21:39.996807+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:3.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:26.504190+0000 46'72 48:86 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:40.363944+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:1.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:23.269511+0000 46'54 47:75 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.182 INFO:tasks.workunit.client.0.smithi157.stdout:2.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:24.977425+0000 46'72 48:92 [3,5,1] 3 [3,5,1] 3 0'0 2020-02-01T18:21:41.103931+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:3.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.290988+0000 46'67 47:81 [4,3,5] 4 [4,3,5] 4 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:3.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:26.332129+0000 46'64 48:78 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:41.872723+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:1.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:23.202933+0000 46'51 48:75 [3,0,1] 3 [3,0,1] 3 0'0 2020-02-01T18:21:42.242261+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:2.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:25.027223+0000 46'53 48:73 [3,0,2] 3 [3,0,2] 3 0'0 2020-02-01T18:21:42.612588+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:3.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:26.259977+0000 46'53 47:67 [4,3,0] 4 [4,3,0] 4 0'0 2020-02-08T18:19:25.333412+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:1.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:23.311089+0000 46'73 47:94 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-08T18:19:22.392233+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:26.183 INFO:tasks.workunit.client.0.smithi157.stdout:2.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:24.522559+0000 46'64 48:82 [1,0,4] 1 [1,0,4] 1 0'0 2020-02-01T18:21:43.723097+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:26.184 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:23:26.184 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:23:26.184 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:26.185 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:26.185 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:23:26.422 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:26.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:110: TEST_recover_unexpected: sleep 1 2020-02-08T18:23:27.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:103: TEST_recover_unexpected: for i in $(seq 0 300) 2020-02-08T18:23:27.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:105: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:27.671 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:3.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.535989+0000 46'67 48:82 [3,1,0] 3 [3,1,0] 3 0'0 2020-02-01T18:21:26.317433+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:1.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:23.270633+0000 46'62 48:86 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:26.684835+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:2.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:24.642183+0000 46'60 48:79 [2,0,5] 2 [2,0,5] 2 0'0 2020-02-01T18:21:27.054407+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:3.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:26.370718+0000 46'60 48:73 [5,3,1] 5 [5,3,1] 5 0'0 2020-02-01T18:21:27.424375+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:1.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:23.272587+0000 46'69 48:92 [1,4,2] 1 [1,4,2] 1 0'0 2020-02-01T18:21:27.792691+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:2.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.560132+0000 46'67 48:84 [5,1,3] 5 [5,1,3] 5 0'0 2020-02-01T18:21:28.162055+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.672 INFO:tasks.workunit.client.0.smithi157.stdout:3.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:26.370499+0000 46'62 48:76 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:28.532495+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:1.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.271128+0000 46'67 48:89 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:28.901930+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:2.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:24.642240+0000 46'69 48:88 [2,3,5] 2 [2,3,5] 2 0'0 2020-02-01T18:21:29.274693+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:3.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:26.432403+0000 46'69 48:84 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:29.642408+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:1.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:23.270499+0000 46'60 48:84 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:30.010608+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:2.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:24.560134+0000 46'62 48:80 [0,5,4] 0 [0,5,4] 0 0'0 2020-02-01T18:21:30.379948+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:3.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.319069+0000 46'61 48:77 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:30.749878+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.673 INFO:tasks.workunit.client.0.smithi157.stdout:1.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:23.155413+0000 46'65 48:88 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:31.117744+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:2.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:24.479809+0000 46'66 48:84 [0,2,1] 0 [0,2,1] 0 0'0 2020-02-01T18:21:31.502375+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:3.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:26.292381+0000 46'66 48:82 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:31.870934+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:1.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.270241+0000 46'61 48:84 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:32.238387+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:2.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:25.027662+0000 46'61 48:81 [4,1,0] 4 [4,1,0] 4 0'0 2020-02-01T18:21:32.608896+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:3.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:26.535834+0000 46'65 48:80 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:32.977124+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:1.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.272335+0000 46'61 48:84 [1,4,5] 1 [1,4,5] 1 0'0 2020-02-01T18:21:33.344518+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:2.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:24.479833+0000 46'61 48:79 [1,5,0] 1 [1,5,0] 1 0'0 2020-02-01T18:21:33.713211+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.674 INFO:tasks.workunit.client.0.smithi157.stdout:3.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.370557+0000 46'61 48:76 [3,1,5] 3 [3,1,5] 3 0'0 2020-02-01T18:21:34.080330+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:1.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:23.269806+0000 46'66 48:88 [5,4,3] 5 [5,4,3] 5 0'0 2020-02-01T18:21:34.450088+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:2.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:24.913254+0000 46'65 48:85 [3,2,5] 3 [3,2,5] 3 0'0 2020-02-01T18:21:34.821044+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:3.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:26.432347+0000 46'73 48:86 [5,3,4] 5 [5,3,4] 5 0'0 2020-02-01T18:21:35.189547+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:1.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:23.155495+0000 46'53 48:76 [1,3,0] 1 [1,3,0] 1 0'0 2020-02-01T18:21:35.559315+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:2.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:24.522195+0000 46'51 48:69 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:35.928217+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:3.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:26.503781+0000 46'51 48:65 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:36.295157+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.675 INFO:tasks.workunit.client.0.smithi157.stdout:1.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:23.269659+0000 46'64 48:88 [3,4,2] 3 [3,4,2] 3 0'0 2020-02-01T18:21:36.665519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:2.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:25.027062+0000 46'73 48:93 [3,4,0] 3 [3,4,0] 3 0'0 2020-02-01T18:21:37.034661+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:1.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.269581+0000 46'67 48:89 [5,0,4] 5 [5,0,4] 5 0'0 2020-02-01T18:21:37.402519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:2.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:24.479931+0000 46'55 48:72 [5,1,0] 5 [5,1,0] 5 0'0 2020-02-01T18:21:37.769550+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:3.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:26.292648+0000 46'54 48:70 [4,0,5] 4 [4,0,5] 4 0'0 2020-02-01T18:21:38.140043+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:23.155746+0000 46'72 48:95 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:38.509437+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:2.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:24.523414+0000 46'54 48:71 [5,4,1] 5 [5,4,1] 5 0'0 2020-02-01T18:21:38.884250+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:3.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:26.535894+0000 46'55 48:70 [3,5,0] 3 [3,5,0] 3 0'0 2020-02-01T18:21:39.255006+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.676 INFO:tasks.workunit.client.0.smithi157.stdout:1.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:23.271090+0000 46'55 48:76 [0,4,1] 0 [0,4,1] 0 0'0 2020-02-01T18:21:39.628056+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:2.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.642179+0000 46'67 48:86 [2,5,0] 2 [2,5,0] 2 0'0 2020-02-01T18:21:39.996807+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:3.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:26.504190+0000 46'72 48:86 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:40.363944+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:1.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:23.269511+0000 46'54 48:77 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:40.735837+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:2.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:24.977425+0000 46'72 48:92 [3,5,1] 3 [3,5,1] 3 0'0 2020-02-01T18:21:41.103931+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:3.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.290988+0000 46'67 48:83 [4,3,5] 4 [4,3,5] 4 0'0 2020-02-01T18:21:41.499734+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:3.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:26.332129+0000 46'64 48:78 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:41.872723+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.677 INFO:tasks.workunit.client.0.smithi157.stdout:1.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:23.202933+0000 46'51 48:75 [3,0,1] 3 [3,0,1] 3 0'0 2020-02-01T18:21:42.242261+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.678 INFO:tasks.workunit.client.0.smithi157.stdout:2.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:25.027223+0000 46'53 48:73 [3,0,2] 3 [3,0,2] 3 0'0 2020-02-01T18:21:42.612588+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.678 INFO:tasks.workunit.client.0.smithi157.stdout:3.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:26.259977+0000 46'53 48:69 [4,3,0] 4 [4,3,0] 4 0'0 2020-02-01T18:21:42.979489+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:27.678 INFO:tasks.workunit.client.0.smithi157.stdout:1.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:23.311089+0000 46'73 48:96 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:43.353531+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:27.679 INFO:tasks.workunit.client.0.smithi157.stdout:2.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:24.522559+0000 46'64 48:82 [1,0,4] 1 [1,0,4] 1 0'0 2020-02-01T18:21:43.723097+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:27.679 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:23:27.679 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:23:27.680 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:27.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:27.682 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:23:27.914 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:27.923 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:110: TEST_recover_unexpected: sleep 1 2020-02-08T18:23:28.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:103: TEST_recover_unexpected: for i in $(seq 0 300) 2020-02-08T18:23:28.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:105: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:29.166 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:23:29.166 INFO:tasks.workunit.client.0.smithi157.stdout:3.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.535989+0000 46'67 48:83 [3,1,0] 3 [3,1,0] 3 0'0 2020-02-01T18:21:26.317433+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.166 INFO:tasks.workunit.client.0.smithi157.stdout:1.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:23.270633+0000 46'62 48:87 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:26.684835+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:2.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:24.642183+0000 46'60 48:79 [2,0,5] 2 [2,0,5] 2 0'0 2020-02-01T18:21:27.054407+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:3.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:26.370718+0000 46'60 48:74 [5,3,1] 5 [5,3,1] 5 0'0 2020-02-01T18:21:27.424375+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:1.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:23.272587+0000 46'69 48:92 [1,4,2] 1 [1,4,2] 1 0'0 2020-02-01T18:21:27.792691+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:2.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.560132+0000 46'67 48:85 [5,1,3] 5 [5,1,3] 5 0'0 2020-02-01T18:21:28.162055+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:3.f 62 0 0 0 0 507904 0 0 62 62 active+clean+scrubbing 2020-02-08T18:23:26.888557+0000 46'62 49:78 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:28.532495+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:1.d 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.271128+0000 46'67 48:89 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:28.901930+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.167 INFO:tasks.workunit.client.0.smithi157.stdout:2.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:24.642240+0000 46'69 48:88 [2,3,5] 2 [2,3,5] 2 0'0 2020-02-01T18:21:29.274693+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:3.e 69 0 0 0 0 565248 0 0 69 69 active+clean 2020-02-08T18:19:26.432403+0000 46'69 48:84 [2,4,1] 2 [2,4,1] 2 0'0 2020-02-01T18:21:29.642408+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:1.c 60 0 0 0 0 491520 0 0 60 60 active+clean 2020-02-08T18:19:23.270499+0000 46'60 48:85 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:30.010608+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:2.f 62 0 0 0 0 507904 0 0 62 62 active+clean 2020-02-08T18:19:24.560134+0000 46'62 48:81 [0,5,4] 0 [0,5,4] 0 0'0 2020-02-01T18:21:30.379948+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:3.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.319069+0000 46'61 48:77 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:30.749878+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:1.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:23.155413+0000 46'65 48:88 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:31.117744+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:2.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:24.479809+0000 46'66 48:85 [0,2,1] 0 [0,2,1] 0 0'0 2020-02-01T18:21:31.502375+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:3.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:26.292381+0000 46'66 48:82 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:31.870934+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.168 INFO:tasks.workunit.client.0.smithi157.stdout:1.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.270241+0000 46'61 48:84 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:32.238387+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:2.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:25.027662+0000 46'61 48:81 [4,1,0] 4 [4,1,0] 4 0'0 2020-02-01T18:21:32.608896+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:3.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:26.535834+0000 46'65 48:81 [3,0,4] 3 [3,0,4] 3 0'0 2020-02-01T18:21:32.977124+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:1.9 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:23.272335+0000 46'61 48:84 [1,4,5] 1 [1,4,5] 1 0'0 2020-02-01T18:21:33.344518+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:2.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:24.479833+0000 46'61 48:79 [1,5,0] 1 [1,5,0] 1 0'0 2020-02-01T18:21:33.713211+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:3.a 61 0 0 0 0 499712 0 0 61 61 active+clean 2020-02-08T18:19:26.370557+0000 46'61 48:77 [3,1,5] 3 [3,1,5] 3 0'0 2020-02-01T18:21:34.080330+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:1.8 66 0 0 0 0 540672 0 0 66 66 active+clean 2020-02-08T18:19:23.269806+0000 46'66 48:89 [5,4,3] 5 [5,4,3] 5 0'0 2020-02-01T18:21:34.450088+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.169 INFO:tasks.workunit.client.0.smithi157.stdout:2.b 65 0 0 0 0 532480 0 0 65 65 active+clean 2020-02-08T18:19:24.913254+0000 46'65 48:86 [3,2,5] 3 [3,2,5] 3 0'0 2020-02-01T18:21:34.821044+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:3.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:26.432347+0000 46'73 48:87 [5,3,4] 5 [5,3,4] 5 0'0 2020-02-01T18:21:35.189547+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:1.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:23.155495+0000 46'53 48:76 [1,3,0] 1 [1,3,0] 1 0'0 2020-02-01T18:21:35.559315+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:2.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:24.522195+0000 46'51 48:69 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:35.928217+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:3.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:26.503781+0000 46'51 48:65 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:36.295157+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:1.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:23.269659+0000 46'64 48:89 [3,4,2] 3 [3,4,2] 3 0'0 2020-02-01T18:21:36.665519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:2.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:25.027062+0000 46'73 48:94 [3,4,0] 3 [3,4,0] 3 0'0 2020-02-01T18:21:37.034661+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.170 INFO:tasks.workunit.client.0.smithi157.stdout:1.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:23.269581+0000 46'67 48:90 [5,0,4] 5 [5,0,4] 5 0'0 2020-02-01T18:21:37.402519+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:2.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:24.479931+0000 46'55 48:73 [5,1,0] 5 [5,1,0] 5 0'0 2020-02-01T18:21:37.769550+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:3.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:26.292648+0000 46'54 48:70 [4,0,5] 4 [4,0,5] 4 0'0 2020-02-01T18:21:38.140043+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:23.155746+0000 46'72 48:95 [1,0,2] 1 [1,0,2] 1 0'0 2020-02-01T18:21:38.509437+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:2.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:24.523414+0000 46'54 48:72 [5,4,1] 5 [5,4,1] 5 0'0 2020-02-01T18:21:38.884250+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:3.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:26.535894+0000 46'55 48:71 [3,5,0] 3 [3,5,0] 3 0'0 2020-02-01T18:21:39.255006+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:1.2 55 0 0 0 0 450560 0 0 55 55 active+clean 2020-02-08T18:19:23.271090+0000 46'55 48:77 [0,4,1] 0 [0,4,1] 0 0'0 2020-02-01T18:21:39.628056+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.171 INFO:tasks.workunit.client.0.smithi157.stdout:2.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:24.642179+0000 46'67 48:86 [2,5,0] 2 [2,5,0] 2 0'0 2020-02-01T18:21:39.996807+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:3.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:26.504190+0000 46'72 48:86 [1,2,4] 1 [1,2,4] 1 0'0 2020-02-01T18:21:40.363944+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:1.3 54 0 0 0 0 442368 0 0 54 54 active+clean 2020-02-08T18:19:23.269511+0000 46'54 48:77 [4,1,2] 4 [4,1,2] 4 0'0 2020-02-01T18:21:40.735837+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:2.0 72 0 0 0 0 589824 0 0 72 72 active+clean 2020-02-08T18:19:24.977425+0000 46'72 48:93 [3,5,1] 3 [3,5,1] 3 0'0 2020-02-01T18:21:41.103931+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:3.1 67 0 0 0 0 548864 0 0 67 67 active+clean 2020-02-08T18:19:26.290988+0000 46'67 48:83 [4,3,5] 4 [4,3,5] 4 0'0 2020-02-01T18:21:41.499734+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:3.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:26.332129+0000 46'64 48:79 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:41.872723+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:1.4 51 0 0 0 0 417792 0 0 51 51 active+clean 2020-02-08T18:19:23.202933+0000 46'51 48:76 [3,0,1] 3 [3,0,1] 3 0'0 2020-02-01T18:21:42.242261+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:2.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:25.027223+0000 46'53 48:74 [3,0,2] 3 [3,0,2] 3 0'0 2020-02-01T18:21:42.612588+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.172 INFO:tasks.workunit.client.0.smithi157.stdout:3.7 53 0 0 0 0 434176 0 0 53 53 active+clean 2020-02-08T18:19:26.259977+0000 46'53 48:69 [4,3,0] 4 [4,3,0] 4 0'0 2020-02-01T18:21:42.979489+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.173 INFO:tasks.workunit.client.0.smithi157.stdout:1.5 73 0 0 0 0 598016 0 0 73 73 active+clean 2020-02-08T18:19:23.311089+0000 46'73 48:96 [4,2,5] 4 [4,2,5] 4 0'0 2020-02-01T18:21:43.353531+0000 0'0 2020-02-08T18:19:22.392233+0000 0 2020-02-08T18:23:29.173 INFO:tasks.workunit.client.0.smithi157.stdout:2.6 64 0 0 0 0 524288 0 0 64 64 active+clean 2020-02-08T18:19:24.522559+0000 46'64 48:82 [1,0,4] 1 [1,0,4] 1 0'0 2020-02-01T18:21:43.723097+0000 0'0 2020-02-08T18:19:23.885301+0000 0 2020-02-08T18:23:29.173 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:23:29.173 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:23:29.173 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:23:29.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:23:29.409 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:23:29.418 INFO:tasks.workunit.client.0.smithi157.stdout:3.f 62 0 0 0 0 507904 0 0 62 62 active+clean+scrubbing 2020-02-08T18:23:26.888557+0000 46'62 49:78 [0,1,4] 0 [0,1,4] 0 0'0 2020-02-01T18:21:28.532495+0000 0'0 2020-02-08T18:19:25.333412+0000 0 2020-02-08T18:23:29.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:107: TEST_recover_unexpected: ok=true 2020-02-08T18:23:29.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:108: TEST_recover_unexpected: break 2020-02-08T18:23:29.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:112: TEST_recover_unexpected: test true = false 2020-02-08T18:23:29.419 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: TEST_recover_unexpected: local total=0 2020-02-08T18:23:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: TEST_recover_unexpected: local zerocount=0 2020-02-08T18:23:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: TEST_recover_unexpected: local maxzerocount=3 2020-02-08T18:23:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:23:29.420 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:23:29.423 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:23:29.423 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:23:29.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:29.423 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:29.423 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:29.423 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:29.424 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:29.424 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:29.424 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:29.424 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:29.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:29.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:29.512 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:29.512 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:29.512 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:29.513 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:29.513 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:29.522 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:29.522 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:29.523 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:29.523 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:29.523 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:29.523 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:29.524 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:29.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:29.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:29.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:29.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:29.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:29.617 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:23:29.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:23:29.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:29.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:29.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:29.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:29.708 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:29.709 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:23:29.709 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:29.709 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:29.710 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:29.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:29.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:29.719 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:29.719 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:29.814 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:29.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:29.815 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:23:29.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:23:29.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:29.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:29.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:29.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:29.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:29.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:29.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:29.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:29.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:29.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:29.904 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:29.905 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:29.905 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:29.905 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:29.905 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:29.914 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:29.914 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:29.914 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:29.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:30.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:30.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:30.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 2 2020-02-08T18:23:30.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:23:30.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:30.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:30.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:30.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:30.012 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:30.013 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:30.013 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:30.013 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:30.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:30.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:30.099 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:30.100 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:30.100 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:30.100 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:30.100 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:30.109 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:30.109 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:30.109 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:30.109 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:30.109 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:30.109 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:30.110 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:30.110 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:30.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:30.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:30.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:30.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:30.205 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:23:30.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:23:30.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:30.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:30.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:30.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:30.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:30.209 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:30.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:30.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:30.296 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:30.296 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:30.296 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:23:30.296 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:30.297 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:30.304 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:30.304 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:30.305 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:30.305 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:30.305 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:30.305 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:30.306 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:30.306 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:30.306 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:30.306 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:30.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:30.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:30.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:23:30.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:23:30.401 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:30.402 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:30.402 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:30.402 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:30.402 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:30.402 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:30.402 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:30.403 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:30.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:30.403 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:30.490 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:30.491 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:30.491 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:30.491 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:30.491 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:30.499 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:30.499 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:30.500 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:30.500 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:30.500 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:30.500 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:30.500 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:30.500 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:30.501 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:30.501 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:30.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:30.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:30.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:23:30.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:23:30.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:23:30.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:23:30.598 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 0 + 15 2020-02-08T18:23:30.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=15 2020-02-08T18:23:30.599 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:23:30.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:23:34.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:23:34.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:23:34.602 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:23:34.604 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:23:34.605 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:34.606 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:34.606 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:34.607 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:34.607 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:34.607 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:34.607 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:34.607 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:34.607 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:34.608 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:34.706 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:34.706 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:34.707 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:34.707 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:34.707 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:34.716 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:34.716 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:34.716 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:34.717 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:34.717 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:34.717 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:34.717 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:34.717 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:34.718 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:34.718 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:34.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:34.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:34.814 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:23:34.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:23:34.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:34.815 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:34.816 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:34.816 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:34.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:34.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:34.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:34.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:34.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:34.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:34.905 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:34.905 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:23:34.906 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:34.906 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:34.906 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:34.914 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:34.914 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:34.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:35.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:35.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:35.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:23:35.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:23:35.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:35.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:35.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:35.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:35.012 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.013 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.013 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.013 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:35.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:35.100 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:35.100 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:35.101 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:35.101 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:35.101 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:35.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:35.110 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:35.110 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:35.110 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:35.110 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.110 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.111 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.111 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:35.111 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.111 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:35.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:35.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:35.206 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 2 2020-02-08T18:23:35.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:23:35.208 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:35.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:35.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:35.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:35.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.209 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:35.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:35.296 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:35.296 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:35.296 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:35.297 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:35.297 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:35.311 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:35.311 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:35.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:35.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:35.401 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:23:35.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:23:35.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.403 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:35.404 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.404 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:35.491 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:35.491 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:35.491 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:23:35.491 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:35.491 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:35.501 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:35.501 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:35.501 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:35.501 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:35.501 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.501 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.502 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.502 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:35.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:35.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:35.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:35.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:23:35.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:23:35.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:35.598 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:35.598 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:35.598 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:35.598 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.598 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.598 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.599 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:35.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.599 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:35.686 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:35.686 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:35.686 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:35.686 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:35.687 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:35.695 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:35.695 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:35.695 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:35.695 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:35.695 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:35.696 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:35.696 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:35.696 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:35.696 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:35.696 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:35.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:35.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:35.791 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:23:35.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:23:35.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:23:35.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:23:35.793 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 15 + 15 2020-02-08T18:23:35.793 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=30 2020-02-08T18:23:35.794 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:23:35.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:23:39.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:23:39.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:23:39.797 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:23:39.798 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:23:39.799 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:39.800 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:39.800 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:39.801 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:39.801 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:39.802 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:39.802 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:39.802 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:39.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:39.802 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:39.898 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:39.898 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:39.898 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:39.898 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:39.899 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:39.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:39.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:39.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:40.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:40.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:40.004 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:23:40.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:23:40.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:40.007 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:40.007 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:40.007 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:40.007 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.007 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.007 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.008 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:40.008 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:40.095 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:40.095 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:23:40.096 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:40.096 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:40.096 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:40.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:40.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:40.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:40.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:40.105 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.105 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.105 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.105 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:40.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:40.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:40.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:40.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:23:40.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:23:40.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:40.205 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:40.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:40.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:40.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.209 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.209 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:40.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.210 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:40.290 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:40.290 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:40.290 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:40.290 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:40.290 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:40.299 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:40.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:40.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:40.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:40.299 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.299 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.300 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:40.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:40.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:40.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:40.395 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 2 2020-02-08T18:23:40.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:23:40.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:40.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:40.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:40.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:40.397 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.397 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.398 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.398 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:40.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:40.485 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:40.486 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:40.486 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:40.486 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:40.486 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:40.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:40.495 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:40.495 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:40.495 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:40.495 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.495 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.495 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.496 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:40.496 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.496 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:40.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:40.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:40.591 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:23:40.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:23:40.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:40.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:40.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:40.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:40.594 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.594 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.595 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:40.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:40.684 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:40.684 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:40.684 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:23:40.684 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:40.684 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:40.693 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:40.693 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:40.693 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:40.693 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:40.693 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.693 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.694 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.694 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:40.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:40.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:40.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:40.790 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:23:40.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:23:40.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:40.793 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:40.793 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:40.793 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:40.794 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.794 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.794 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.794 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:40.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:40.881 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:40.881 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:40.882 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:40.882 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:40.882 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:40.891 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:40.891 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:40.891 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:40.891 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:40.892 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:40.892 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:40.892 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:40.892 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:40.892 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:40.894 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:40.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:40.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:40.987 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:23:40.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:23:40.988 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:23:40.988 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:23:40.989 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 30 + 15 2020-02-08T18:23:40.989 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=45 2020-02-08T18:23:40.990 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:23:40.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:23:44.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:23:44.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:23:44.993 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:23:44.994 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:23:44.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:44.996 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:44.997 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:44.997 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:44.998 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:44.998 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:44.998 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:44.998 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:44.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:44.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:45.094 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:45.095 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:45.095 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:45.095 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:45.095 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:45.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:45.104 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.105 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.105 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.105 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:45.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:45.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:45.200 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:45.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:23:45.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:23:45.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:45.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:45.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:45.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:45.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.204 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.204 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:45.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:45.290 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:45.291 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:23:45.291 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:45.291 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:45.291 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:45.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:45.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:45.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:45.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:45.300 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.301 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.301 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.301 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:45.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.302 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:45.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:45.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:45.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:23:45.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:23:45.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:45.399 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:45.487 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:45.487 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:45.487 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:45.487 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:45.487 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:45.496 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:45.496 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:45.496 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:45.496 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:45.496 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.496 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.497 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:45.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:45.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:45.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:45.593 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 2 2020-02-08T18:23:45.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:23:45.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:45.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:45.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:45.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:45.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:45.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:45.682 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:45.682 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:45.682 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:45.682 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:45.682 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:45.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:45.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:45.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.692 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:45.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.693 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:45.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:45.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:45.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:23:45.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:23:45.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:45.789 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:45.789 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:45.789 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:45.790 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.790 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.790 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.791 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:45.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:45.878 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:45.878 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:45.878 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:23:45.878 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:45.878 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:45.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:45.888 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:45.888 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:45.888 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:45.888 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.889 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:45.889 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.890 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:45.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:45.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:45.983 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:23:45.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:23:45.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:45.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:45.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:45.987 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:45.987 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:45.987 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:45.987 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:45.988 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:45.988 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:45.988 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:46.073 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:46.073 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:46.073 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:46.074 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:46.074 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:46.083 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:46.083 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:46.083 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:46.083 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:46.084 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:46.084 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:46.084 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:46.084 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:46.084 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:46.085 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:46.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:46.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:46.178 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:23:46.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:23:46.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:23:46.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:23:46.180 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 45 + 15 2020-02-08T18:23:46.180 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=60 2020-02-08T18:23:46.181 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:23:46.182 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:23:50.183 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:23:50.183 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:23:50.185 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:23:50.186 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:23:50.187 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:50.188 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:50.188 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:50.188 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:50.189 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.189 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.189 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.189 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:50.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:50.286 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:50.287 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:50.287 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:50.287 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:50.288 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:50.298 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:50.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:50.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:50.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:50.299 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.300 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.300 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:50.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:50.393 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:50.393 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:50.394 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:23:50.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:23:50.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:50.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:50.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:50.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:50.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:50.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:50.485 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:50.485 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:23:50.485 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:50.485 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:50.485 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:50.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:50.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:50.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:50.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:50.494 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.495 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.495 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.495 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:50.495 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.495 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:50.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:50.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:50.590 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:23:50.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:23:50.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:50.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:50.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:50.681 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:50.681 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:50.681 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:23:50.681 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:50.681 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:50.690 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:50.690 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:50.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:50.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:50.691 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.691 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.692 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.692 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:50.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:50.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:50.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:50.788 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 1 2020-02-08T18:23:50.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:23:50.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:50.790 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:50.791 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:50.791 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:50.791 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.791 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.791 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.792 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:50.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.792 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:50.878 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:50.878 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:50.878 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:50.878 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:50.878 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:50.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:50.887 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:50.887 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:50.887 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:50.887 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.888 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.888 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.888 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:50.888 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.888 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:50.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:50.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:50.983 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:23:50.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:23:50.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:50.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:50.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:50.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:51.073 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:51.074 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:51.074 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:51.074 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:51.074 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:51.084 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:51.084 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:51.084 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:51.084 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:51.084 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:51.085 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:51.085 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:51.085 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:51.085 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:51.085 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:51.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:51.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:51.177 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:23:51.178 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:23:51.179 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:51.180 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:51.180 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:51.180 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:51.180 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:51.180 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:51.180 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:51.181 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:51.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:51.181 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:51.270 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:51.270 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:51.270 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:51.270 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:51.270 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:51.277 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:51.278 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:51.279 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:51.279 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:51.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:51.373 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:51.374 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 1 2020-02-08T18:23:51.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:23:51.375 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 11 = 0 ']' 2020-02-08T18:23:51.375 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:23:51.376 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 60 + 11 2020-02-08T18:23:51.376 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=71 2020-02-08T18:23:51.376 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:23:51.377 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:23:55.379 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:23:55.379 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:23:55.380 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:23:55.381 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:23:55.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:55.383 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:55.383 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:55.384 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:55.384 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.384 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.385 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.385 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:55.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.385 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:55.481 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:55.481 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:55.481 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:23:55.481 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:55.481 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:55.490 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:55.490 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:23:55.490 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:23:55.491 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:23:55.491 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.491 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.491 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.491 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:23:55.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:23:55.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:23:55.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:23:55.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:23:55.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:23:55.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:55.588 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:55.588 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:55.588 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:55.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.590 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.590 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:55.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:55.677 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:55.677 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:55.678 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:55.678 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:55.678 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:55.686 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:55.686 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:23:55.687 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:23:55.687 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:23:55.687 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.687 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.687 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.687 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:23:55.688 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.688 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:23:55.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:55.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:55.782 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 2 2020-02-08T18:23:55.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:23:55.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:55.785 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:55.785 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:55.785 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:55.786 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.786 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.786 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.786 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:55.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:55.872 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:55.872 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:55.872 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:55.872 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:55.872 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:55.880 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:55.880 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:23:55.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:23:55.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:23:55.881 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.881 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.881 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:23:55.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:23:55.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:23:55.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:23:55.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 1 2020-02-08T18:23:55.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:23:55.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:55.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:55.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:55.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:55.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:55.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:55.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:55.986 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:55.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:55.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:56.066 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:56.067 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:23:56.067 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:56.067 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:56.067 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:56.076 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:56.077 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:23:56.077 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:23:56.077 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:23:56.077 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:56.078 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:56.078 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:56.078 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:23:56.078 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:56.078 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:23:56.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:23:56.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:23:56.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 2 2020-02-08T18:23:56.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:23:56.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:56.173 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:56.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:56.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:56.175 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:56.175 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:56.175 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:56.175 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:56.175 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:56.175 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:56.263 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:56.264 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:23:56.264 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:23:56.264 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:56.264 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:56.271 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:56.271 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:56.272 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:23:56.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:23:56.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:23:56.368 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 4 2020-02-08T18:23:56.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:23:56.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:23:56.373 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:56.374 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:56.374 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:56.374 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:56.374 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:56.374 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:56.375 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:56.375 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:56.375 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:56.458 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:23:56.458 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:23:56.458 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:23:56.459 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:23:56.459 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:23:56.468 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:23:56.468 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:23:56.468 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:23:56.469 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:23:56.469 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:23:56.469 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:23:56.469 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:23:56.469 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:23:56.470 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:23:56.470 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:23:56.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:23:56.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:23:56.564 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 3 2020-02-08T18:23:56.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:23:56.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:23:56.565 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:23:56.566 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 71 + 15 2020-02-08T18:23:56.566 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=86 2020-02-08T18:23:56.567 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:23:56.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:00.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:00.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:00.571 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:00.572 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:00.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:00.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:00.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:00.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:00.575 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:00.575 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:00.576 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:00.576 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:00.576 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:00.576 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:00.673 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:00.673 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:00.674 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:00.674 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:00.674 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:00.683 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:00.683 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:00.683 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:00.683 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:00.683 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:00.683 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:00.684 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:00.684 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:00.684 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:00.684 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:00.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:00.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:00.779 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:00.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:00.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:00.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:00.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:00.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:00.781 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:00.781 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:00.781 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:00.782 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:00.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:00.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:00.870 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:00.870 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:00.870 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:00.871 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:00.871 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:00.880 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:00.880 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:00.880 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:00.880 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:00.880 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:00.880 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:00.881 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:00.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:00.881 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:00.881 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:00.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:00.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:00.976 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:00.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:00.977 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:00.977 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:00.978 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:00.978 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:00.979 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:00.979 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:00.979 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:00.979 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:00.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:00.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:01.066 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:01.066 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:01.066 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:01.066 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:01.067 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:01.074 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:01.076 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.076 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:01.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:01.171 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:01.171 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:24:01.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:24:01.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:01.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:01.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:01.173 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:01.173 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.174 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.174 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:01.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.174 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:01.262 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:01.262 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:01.262 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:01.262 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:01.262 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.271 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.272 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:01.272 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.272 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:01.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:01.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:01.368 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:24:01.368 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:01.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:01.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:01.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:01.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:01.370 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.370 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.370 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.371 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:01.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:01.456 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:01.456 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:01.457 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:01.457 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:01.457 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:01.465 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:01.465 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:01.465 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:01.465 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:01.466 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.466 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.466 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.466 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:01.467 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.467 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:01.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:01.560 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:01.560 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:24:01.561 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:24:01.561 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:01.563 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:01.563 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:01.563 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:01.564 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.564 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.564 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.564 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:01.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.564 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:01.651 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:01.651 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:01.652 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:01.652 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:01.652 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:01.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:01.660 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:01.660 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:01.660 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:01.661 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:01.661 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:01.662 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:01.662 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:01.662 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:01.662 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:01.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:01.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:01.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:24:01.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:01.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:01.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:01.759 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 86 + 18 2020-02-08T18:24:01.759 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=104 2020-02-08T18:24:01.761 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:01.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:05.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:05.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:05.767 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:05.767 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:05.767 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:05.769 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:05.769 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:05.769 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:05.770 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:05.770 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:05.770 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:05.770 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:05.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:05.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:05.865 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:05.865 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:05.865 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:05.866 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:05.866 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:05.874 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:05.875 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:05.876 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:05.876 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:05.970 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:05.970 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:05.971 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:05.972 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:05.972 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:05.974 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:05.974 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:05.974 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:05.974 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:05.974 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:05.975 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:05.975 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:05.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:05.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:06.061 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:06.061 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:06.061 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:06.061 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:06.061 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:06.071 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.072 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:06.073 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.073 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:06.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:06.164 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:06.165 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:06.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:06.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:06.167 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:06.167 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:06.167 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:06.167 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.167 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.167 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:06.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:06.254 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:06.255 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:06.255 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:06.255 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:06.255 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:06.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:06.265 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:06.265 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:06.265 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:06.266 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.266 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.266 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.266 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:06.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:06.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:06.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:06.361 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:24:06.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:24:06.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:06.363 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:06.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:06.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:06.364 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.364 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.364 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:06.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:06.453 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:06.453 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:06.453 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:06.454 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:06.454 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:06.462 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:06.462 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:06.462 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:06.462 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:06.463 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.463 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.463 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.463 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:06.463 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.463 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:06.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:06.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:06.558 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:24:06.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:06.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:06.560 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:06.561 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:06.561 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:06.561 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.561 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.561 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.561 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:06.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:06.653 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:06.653 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:06.654 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:06.654 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:06.654 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:06.667 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:06.667 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:06.667 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:06.667 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:06.667 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.668 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:06.668 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.668 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:06.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:06.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:06.755 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:24:06.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:24:06.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:06.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:06.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:06.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:06.757 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.757 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.758 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.758 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:06.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:06.846 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:06.846 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:06.846 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:06.847 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:06.847 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:06.857 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:06.857 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:06.857 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:06.857 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:06.858 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:06.858 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:06.858 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:06.858 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:06.858 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:06.859 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:06.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:06.951 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:06.951 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:24:06.952 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:06.952 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:06.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:06.953 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 104 + 18 2020-02-08T18:24:06.953 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=122 2020-02-08T18:24:06.954 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:06.955 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:10.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:10.956 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:10.958 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:10.959 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:10.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:10.961 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:10.961 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:10.961 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:10.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:10.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:10.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:10.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:10.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:10.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:11.059 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:11.060 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:11.060 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:11.060 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:11.060 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:11.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:11.068 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:11.069 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:11.069 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:11.069 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.070 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.070 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.070 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:11.071 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.071 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:11.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:11.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:11.166 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:11.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:11.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:11.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:11.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:11.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:11.169 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.169 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.171 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:11.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.172 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:11.256 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:11.256 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:11.257 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:11.257 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:11.257 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:11.269 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:11.269 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:11.270 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:11.270 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:11.270 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.270 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.270 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.271 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:11.271 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.271 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:11.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:11.362 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:11.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:11.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:11.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:11.365 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:11.365 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:11.365 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:11.366 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.366 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.366 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.366 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:11.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.366 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:11.452 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:11.452 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:11.452 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:11.453 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:11.453 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:11.461 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.461 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.462 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.462 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:11.462 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.462 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:11.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:11.558 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:11.558 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:24:11.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:24:11.559 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:11.560 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:11.561 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:11.561 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:11.561 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.561 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.561 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.562 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:11.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:11.648 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:11.648 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:11.648 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:11.649 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:11.649 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:11.657 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:11.657 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.658 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:11.659 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.659 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:11.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:11.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:11.755 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:24:11.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:11.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:11.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:11.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:11.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:11.757 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.757 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.757 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.758 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:11.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.758 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:11.845 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:11.845 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:11.845 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:11.845 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:11.845 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:11.854 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:11.855 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:11.855 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:11.855 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:11.855 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.856 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.856 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.856 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:11.856 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.857 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:11.948 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:11.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:11.949 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:24:11.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:24:11.950 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:11.951 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:11.951 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:11.951 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:11.951 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:11.952 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:11.952 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:11.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:11.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:12.039 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:12.039 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:12.040 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:12.040 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:12.040 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:12.048 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:12.048 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:12.048 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:12.049 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:12.144 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:12.144 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:12.144 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:24:12.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:12.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:12.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:12.146 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 122 + 18 2020-02-08T18:24:12.147 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=140 2020-02-08T18:24:12.147 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:12.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:16.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:16.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:16.151 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:16.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:16.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:16.154 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:16.154 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:16.154 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:16.155 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.155 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.155 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.155 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:16.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:16.251 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:16.252 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:16.252 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:16.252 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:16.252 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:16.261 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:16.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:16.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:16.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:16.261 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.262 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:16.262 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:16.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:16.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:16.357 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:16.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:16.358 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:16.359 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:16.360 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:16.360 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:16.360 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.360 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.361 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.361 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:16.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:16.448 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:16.448 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:16.448 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:16.448 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:16.448 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:16.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:16.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:16.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:16.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:16.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:16.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:16.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:16.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:16.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:16.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:16.555 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.556 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:16.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:16.644 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:16.644 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:16.644 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:16.644 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:16.645 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:16.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:16.653 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:16.653 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:16.653 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:16.654 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.654 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.654 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.654 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:16.654 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.654 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:16.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:16.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:16.750 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:24:16.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:24:16.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:16.752 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:16.753 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:16.753 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:16.753 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.753 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.753 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.754 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:16.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.754 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:16.839 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:16.839 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:16.839 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:16.839 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:16.839 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:16.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:16.848 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:16.848 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:16.848 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:16.848 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.849 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.849 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.849 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:16.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:16.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:16.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:16.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:24:16.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:16.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:16.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:16.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:16.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:16.948 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:16.948 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:16.948 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:16.948 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:16.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:16.949 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:17.034 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:17.034 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:17.034 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:17.035 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:17.035 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:17.042 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:17.043 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:17.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:17.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:17.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:17.138 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:17.139 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:24:17.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:24:17.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:17.140 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:17.140 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:17.141 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:17.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:17.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:17.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:17.141 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:17.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:17.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:17.229 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:17.229 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:17.229 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:17.229 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:17.229 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:17.237 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:17.238 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:17.239 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:17.239 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:17.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:17.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:17.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:24:17.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:17.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:17.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:17.335 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 140 + 18 2020-02-08T18:24:17.336 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=158 2020-02-08T18:24:17.337 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:17.337 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:21.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:21.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:21.340 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:21.342 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:21.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:21.346 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:21.346 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:21.347 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:21.347 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.347 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.347 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.348 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:21.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:21.442 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:21.443 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:21.443 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:24:21.443 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:21.443 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:21.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:21.452 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:21.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:21.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:21.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:21.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 1 2020-02-08T18:24:21.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=1 2020-02-08T18:24:21.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:21.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:21.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:21.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:21.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:21.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:21.639 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:21.639 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:21.640 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:21.640 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:21.640 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:21.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:21.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:21.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:21.649 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:21.649 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.649 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.649 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.649 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:21.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:21.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 1 + 3 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:21.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:21.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.749 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:21.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:21.836 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:21.837 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:21.837 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:21.837 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:21.837 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:21.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:21.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:21.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:21.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:21.846 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.846 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.847 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.847 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:21.847 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.847 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:21.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:21.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:21.942 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:21.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:21.943 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:21.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:21.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:21.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:21.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:21.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:21.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:21.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:21.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:21.946 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:22.034 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:22.034 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:22.034 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:24:22.035 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:22.035 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:22.041 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:22.042 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:22.043 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:22.043 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:22.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:22.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:22.138 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:24:22.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:24:22.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:22.140 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:22.142 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:22.142 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:22.142 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:22.142 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:22.143 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:22.143 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:22.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:22.143 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:22.228 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:22.228 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:22.228 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:22.229 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:22.229 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:22.242 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:22.242 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:22.242 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:22.242 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:22.243 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:22.243 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:22.243 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:22.243 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:22.244 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:22.244 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:22.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:22.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:22.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:24:22.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:24:22.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:22.337 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:22.337 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:22.337 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:22.337 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:22.338 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:22.338 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:22.338 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:22.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:22.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:22.424 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:22.425 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:22.425 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:24:22.425 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:22.425 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:22.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:22.433 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:22.434 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:22.434 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:22.434 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:22.434 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:22.434 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:22.434 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:22.435 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:22.435 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:22.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:24:22.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:24:22.530 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 0 2020-02-08T18:24:22.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:24:22.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 13 = 0 ']' 2020-02-08T18:24:22.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:22.531 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 158 + 13 2020-02-08T18:24:22.532 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=171 2020-02-08T18:24:22.533 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:22.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:26.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:26.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:26.536 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:26.538 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:26.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:26.541 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:26.542 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:26.542 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:26.543 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:26.543 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:26.543 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:26.543 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:26.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:26.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:26.638 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:26.638 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:26.638 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:26.638 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:26.639 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:26.651 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:26.651 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:26.651 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:26.652 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:26.652 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:26.652 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:26.652 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:26.653 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:26.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:26.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:26.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:26.746 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:24:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:24:26.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:26.749 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:26.749 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:26.749 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:26.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:26.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:26.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:26.750 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:26.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:26.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:26.835 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:26.836 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:26.836 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:26.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:26.845 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:26.845 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:26.845 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:26.845 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:26.846 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:26.846 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:26.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:26.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:26.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:26.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:26.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:26.941 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:24:26.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:24:26.942 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:26.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:26.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:26.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:26.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:26.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:26.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:26.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:26.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:26.945 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:27.033 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:27.042 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:27.042 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:27.042 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:27.042 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:27.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.045 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.046 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:27.046 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.046 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:27.135 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:27.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:27.136 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 4 2020-02-08T18:24:27.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:27.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:27.138 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:27.149 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:27.149 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:27.149 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.149 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.150 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.150 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:27.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:27.226 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:27.226 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:27.227 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:27.227 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:27.227 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:27.235 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:27.236 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:27.236 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:27.236 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:27.236 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.236 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.237 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.237 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:27.237 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.237 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:27.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:27.331 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:27.331 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 3 2020-02-08T18:24:27.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:24:27.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:27.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:27.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:27.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:27.334 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.335 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.335 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.335 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:27.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:27.423 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:27.423 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:27.423 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:27.423 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:27.423 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.432 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.433 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:27.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:27.526 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:27.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:27.527 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:24:27.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:24:27.528 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:27.529 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:27.529 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:27.530 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:27.530 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.530 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.530 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.530 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:27.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:27.616 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:27.617 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:27.617 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:27.617 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:27.617 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:27.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:27.626 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:27.626 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:27.626 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:27.626 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:27.626 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:27.627 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:27.627 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:27.627 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:27.627 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:27.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:27.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:27.721 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 1 2020-02-08T18:24:27.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:27.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:27.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:27.723 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 171 + 18 2020-02-08T18:24:27.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=189 2020-02-08T18:24:27.725 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:27.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:31.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:31.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:31.728 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:31.729 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:31.730 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:31.732 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:31.732 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:31.733 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:31.733 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:31.733 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:31.733 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:31.734 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:31.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:31.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:31.829 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:31.829 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:31.829 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:31.829 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:31.830 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:31.839 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:31.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:31.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:31.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:31.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:31.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:31.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:31.840 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:31.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:31.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:31.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:31.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:31.935 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:24:31.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:24:31.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:31.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:31.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:31.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:31.938 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:31.939 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:31.939 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:31.939 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:31.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:31.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:32.026 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:32.026 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:32.026 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:32.026 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:32.026 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:32.040 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:32.040 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:32.040 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:32.040 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:32.041 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.041 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.041 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.041 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:32.041 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.041 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:32.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:32.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:32.131 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:24:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:24:32.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:32.135 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:32.135 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:32.135 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:32.135 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.136 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.136 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.136 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:32.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.137 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:32.221 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:32.222 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:32.222 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:32.222 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:32.222 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:32.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:32.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:32.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:32.231 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:32.231 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.231 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.231 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.233 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:32.233 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.233 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:32.324 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:32.325 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:32.325 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 4 2020-02-08T18:24:32.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:32.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:32.328 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:32.328 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:32.329 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:32.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:32.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:32.419 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:32.419 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:32.419 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:32.420 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:32.420 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:32.427 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:32.428 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.429 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.429 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.429 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:32.429 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:32.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:32.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:32.523 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 3 2020-02-08T18:24:32.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:32.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.525 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:32.611 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:32.611 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:32.611 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:32.611 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:32.611 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:32.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.621 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:32.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:32.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:32.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:32.718 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:24:32.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:24:32.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:32.720 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:32.720 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:32.720 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:32.721 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.721 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.721 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.721 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:32.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:32.807 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:32.808 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:32.808 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:32.808 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:32.808 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:32.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:32.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:32.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:32.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:32.817 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:32.818 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:32.818 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:32.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:32.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:32.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:32.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:32.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:32.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 1 2020-02-08T18:24:32.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:32.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:32.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:32.913 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 189 + 18 2020-02-08T18:24:32.914 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=207 2020-02-08T18:24:32.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:32.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:36.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:36.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:36.919 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:36.920 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:36.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:36.922 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:36.922 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:36.922 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:36.923 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:36.924 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:36.924 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:36.924 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:36.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:36.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:37.020 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:37.020 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:37.020 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:37.021 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:37.021 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:37.029 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:37.031 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.031 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:37.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:37.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:37.127 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:24:37.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:24:37.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:37.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:37.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:37.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:37.130 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.130 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.130 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.130 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:37.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:37.218 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:37.218 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:37.218 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:37.218 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:37.218 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:37.227 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:37.227 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:37.227 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:37.227 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:37.227 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.228 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.228 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.228 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:37.228 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.228 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:37.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:37.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:37.322 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:24:37.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:24:37.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.325 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:37.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:37.413 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:37.413 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:37.413 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:37.414 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:37.414 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:37.422 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:37.423 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:37.423 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:37.423 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:37.423 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.424 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.424 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.424 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:37.424 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.424 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:37.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:37.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:37.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 4 2020-02-08T18:24:37.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:37.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:37.520 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:37.520 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:37.521 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:37.521 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.521 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.521 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.522 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:37.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:37.607 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:37.608 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:37.608 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:37.608 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:37.608 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:37.617 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:37.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:37.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:37.618 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:37.618 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.618 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.618 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.618 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:37.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:37.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:37.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:37.712 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 3 2020-02-08T18:24:37.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:24:37.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:37.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:37.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:37.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:37.715 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.715 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.716 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.716 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:37.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:37.803 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:37.804 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:37.804 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:37.804 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:37.804 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:37.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:37.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:37.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.819 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:37.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:37.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:37.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:24:37.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:24:37.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:37.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:37.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:37.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:37.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:37.912 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:37.912 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:37.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:37.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:37.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:37.999 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:38.000 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:38.000 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:38.000 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:38.000 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:38.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:38.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:38.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:38.010 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:38.011 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:38.011 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:38.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:38.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:38.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 1 2020-02-08T18:24:38.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:24:38.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:24:38.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:38.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 207 + 18 2020-02-08T18:24:38.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=225 2020-02-08T18:24:38.108 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:38.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:42.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:42.111 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:42.111 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:42.113 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:42.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:42.115 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:42.115 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:42.115 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:42.116 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.117 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.117 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.117 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:42.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:42.214 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:42.214 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:42.214 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:42.214 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:42.214 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:42.223 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:42.223 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:42.224 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.225 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:42.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:42.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:42.320 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 1 2020-02-08T18:24:42.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=1 2020-02-08T18:24:42.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:42.322 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:42.322 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:42.322 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:42.323 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.323 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.323 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.323 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:42.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:42.410 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:42.410 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:42.411 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:42.411 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:42.411 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:42.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:42.430 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:42.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:42.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:42.431 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.431 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.432 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.432 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:42.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:42.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:42.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:42.514 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 1 + 3 2020-02-08T18:24:42.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:42.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:42.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:42.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:42.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:42.518 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.518 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.518 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:42.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:42.606 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:42.606 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:42.606 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:42.607 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:42.607 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:42.616 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:42.616 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:42.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:42.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:42.617 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.617 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.618 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.618 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:42.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:42.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:42.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:42.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:24:42.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:24:42.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:42.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:42.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:42.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:42.717 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.718 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:42.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.719 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:42.804 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:42.804 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:42.804 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:42.804 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:42.805 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:42.813 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:42.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:42.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:42.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:42.814 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.814 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.815 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.815 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:42.815 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.815 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:42.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:42.909 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:42.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 3 2020-02-08T18:24:42.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:24:42.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:42.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:42.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:42.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:42.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:42.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:42.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:42.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:43.001 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:43.001 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:43.001 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:43.001 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:43.002 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:43.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:43.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:43.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:43.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:43.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:43.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:43.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:43.010 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:43.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:43.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:43.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:43.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:43.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 3 2020-02-08T18:24:43.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:24:43.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:43.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:43.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:43.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:43.107 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:43.107 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:43.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:43.108 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:43.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:43.195 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:43.196 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:43.196 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:43.196 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:43.196 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:43.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:43.204 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:43.204 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:43.205 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:43.205 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:43.205 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:43.205 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:43.205 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:43.206 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:43.206 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:43.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:24:43.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:24:43.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 1 2020-02-08T18:24:43.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:24:43.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:24:43.303 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:43.303 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 225 + 15 2020-02-08T18:24:43.304 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=240 2020-02-08T18:24:43.304 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:43.305 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:47.307 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:47.307 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:47.308 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:47.310 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:47.310 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:47.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:47.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:47.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:47.313 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.314 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.314 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.314 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:47.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.314 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:47.409 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:47.409 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:47.409 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:47.410 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:47.410 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:47.419 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.420 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:47.421 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.421 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:47.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:47.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:47.516 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:47.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:47.517 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:47.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:47.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:47.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:47.518 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.519 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:47.606 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:47.606 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:47.607 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:47.607 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:47.607 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:47.616 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:47.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:47.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:47.617 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:47.617 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.618 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.618 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.618 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:47.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:47.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:47.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:47.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:47.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:47.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:47.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:47.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:47.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:47.713 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.714 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.714 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:47.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:47.806 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:47.806 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:47.806 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:47.806 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:47.806 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:47.811 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:47.811 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:47.812 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.813 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:47.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:47.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:47.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 4 2020-02-08T18:24:47.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:24:47.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:47.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:47.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:47.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:47.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:47.909 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:47.909 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:47.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:47.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:47.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:47.997 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:47.998 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:47.998 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:47.998 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:47.998 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:48.016 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:48.016 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:48.016 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:48.017 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:48.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:48.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:48.102 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 3 2020-02-08T18:24:48.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:24:48.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:48.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:48.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:48.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:48.105 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:48.105 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:48.105 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:48.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:48.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:48.106 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:48.192 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:48.193 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:48.193 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:48.193 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:48.193 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:48.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:48.202 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:48.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:48.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:48.203 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:48.207 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:48.207 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:48.207 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:48.207 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:48.208 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:48.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:48.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:48.298 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 3 2020-02-08T18:24:48.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:24:48.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:48.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:48.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:48.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:48.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:48.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:48.301 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:48.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:48.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:48.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:48.388 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:48.389 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:48.389 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:48.389 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:48.389 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:48.399 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:48.399 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:48.399 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:48.399 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:48.400 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:48.400 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:48.400 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:48.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:48.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:48.401 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:48.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:48.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:48.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 4 2020-02-08T18:24:48.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=21 2020-02-08T18:24:48.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 21 = 0 ']' 2020-02-08T18:24:48.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:48.499 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 240 + 21 2020-02-08T18:24:48.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=261 2020-02-08T18:24:48.499 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:48.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:52.499 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:52.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:52.501 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:52.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:52.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:52.507 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:52.507 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:52.507 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:52.507 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:52.508 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:52.508 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:52.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:52.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:52.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:52.604 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:52.604 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:52.604 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:52.604 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:52.605 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:52.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:52.624 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:52.624 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:52.624 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:52.625 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:52.625 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:52.625 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:52.625 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:52.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:52.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:52.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:52.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:52.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:52.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:52.714 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:52.716 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:52.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:52.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:52.717 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:52.718 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:52.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:52.803 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:52.803 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:52.803 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:52.804 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:52.804 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:52.812 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:52.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:52.813 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:52.814 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:52.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:52.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:52.907 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:24:52.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:24:52.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:52.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:52.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:52.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:52.910 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:52.910 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:52.910 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:52.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:52.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:52.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:53.000 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:53.000 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:53.000 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:53.000 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:53.001 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:53.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:53.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:53.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:53.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:53.009 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.009 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.010 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.010 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:53.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:53.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:53.104 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:53.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 3 2020-02-08T18:24:53.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:24:53.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:53.107 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:53.107 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:53.108 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:53.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.109 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:53.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:53.194 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:53.194 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:53.194 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:53.194 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:53.195 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:53.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:53.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:53.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:53.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:53.204 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.204 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.204 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.204 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:53.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:53.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:53.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:53.299 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 2 2020-02-08T18:24:53.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:24:53.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:53.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:53.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:53.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:53.302 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.302 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.302 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.302 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:53.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.302 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:53.389 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:53.390 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:53.390 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:53.390 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:53.390 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.399 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:53.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:53.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:53.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:53.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 4 2020-02-08T18:24:53.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=16 2020-02-08T18:24:53.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:53.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.498 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:53.595 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:53.595 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:53.595 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:53.595 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:53.595 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:53.596 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:53.597 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:53.597 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:53.597 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:53.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:53.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:53.690 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 16 + 4 2020-02-08T18:24:53.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=20 2020-02-08T18:24:53.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 20 = 0 ']' 2020-02-08T18:24:53.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:53.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 261 + 20 2020-02-08T18:24:53.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=281 2020-02-08T18:24:53.695 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:53.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:24:57.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:24:57.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:24:57.698 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:24:57.699 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:24:57.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:57.702 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:57.702 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:57.702 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:57.702 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:57.702 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:57.703 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:57.703 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:57.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:57.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:57.799 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:57.800 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:57.800 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:24:57.800 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:57.800 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:57.809 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:57.810 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:24:57.810 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:24:57.810 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:24:57.810 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:57.810 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:57.811 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:57.811 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:24:57.811 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:57.811 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:24:57.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:57.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:57.905 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:24:57.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:24:57.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:57.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:57.907 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:57.907 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:57.907 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:57.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:57.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:57.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:57.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:57.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:57.996 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:57.996 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:57.996 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:24:57.997 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:57.997 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:58.007 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:58.007 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:24:58.007 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:24:58.008 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:24:58.008 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.008 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.008 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:24:58.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:24:58.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:58.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:58.101 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:24:58.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:24:58.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:58.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:58.105 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:58.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:58.106 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.106 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.106 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.107 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:58.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:58.191 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:58.192 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:24:58.192 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:58.192 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:58.192 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:58.201 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:58.201 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:24:58.202 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:24:58.202 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:24:58.202 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.202 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.203 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:24:58.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:24:58.296 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:24:58.296 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:24:58.297 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 3 2020-02-08T18:24:58.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:24:58.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:58.299 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:58.299 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:58.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:58.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:58.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.301 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:58.386 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:58.386 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:24:58.386 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:58.387 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:58.387 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:58.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:58.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:24:58.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:24:58.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:24:58.397 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.397 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.397 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.397 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:24:58.398 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.398 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:24:58.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:24:58.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:24:58.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 2 2020-02-08T18:24:58.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:24:58.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:58.498 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:58.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:58.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:58.502 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.502 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.503 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.503 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:58.503 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:58.582 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:58.582 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:24:58.582 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:24:58.582 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:58.583 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:58.592 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:58.592 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:24:58.593 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:24:58.593 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:24:58.593 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.593 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.594 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.594 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:24:58.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.594 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:24:58.687 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:58.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:58.688 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:24:58.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:24:58.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:24:58.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:58.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:58.691 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:58.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.692 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:58.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:58.777 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:24:58.778 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:24:58.778 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:24:58.778 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:24:58.778 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:24:58.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:24:58.787 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:24:58.787 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:24:58.788 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:24:58.788 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:24:58.788 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:24:58.788 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:24:58.789 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:24:58.789 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:24:58.789 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:24:58.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:24:58.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:24:58.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 4 2020-02-08T18:24:58.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=21 2020-02-08T18:24:58.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 21 = 0 ']' 2020-02-08T18:24:58.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:24:58.884 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 281 + 21 2020-02-08T18:24:58.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=302 2020-02-08T18:24:58.885 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:24:58.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:02.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:02.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:02.889 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:02.890 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:02.891 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:02.893 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:02.893 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:02.894 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:02.894 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:02.894 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:02.894 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:02.894 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:02.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:02.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:02.991 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:02.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:02.992 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:02.992 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:02.992 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:03.003 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:03.003 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:03.003 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:03.003 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:03.004 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.004 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.004 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.004 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:03.004 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:03.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:03.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:03.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:25:03.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:25:03.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:03.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:03.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:03.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:03.100 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.101 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.101 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.101 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:03.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:03.187 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:03.187 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:03.187 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:25:03.187 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:03.187 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:03.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:03.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:03.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:03.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:03.292 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:25:03.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:25:03.297 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:03.297 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:03.297 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:03.298 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:03.298 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.298 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.298 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.299 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:03.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:03.382 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:03.382 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:03.383 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:03.383 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:03.383 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:03.395 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:03.395 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:03.395 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:03.395 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:03.395 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.396 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.396 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.396 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:03.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:03.486 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:03.486 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:03.487 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 3 2020-02-08T18:25:03.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:25:03.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:03.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:03.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:03.578 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:03.578 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:03.578 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:03.578 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:03.579 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:03.587 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:03.589 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.589 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:03.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:03.682 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:03.682 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 2 2020-02-08T18:25:03.691 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:25:03.692 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:03.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:03.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:03.692 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:03.693 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.693 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.693 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:03.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:03.773 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:03.773 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:25:03.773 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:03.773 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:03.773 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:03.782 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:03.783 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:03.783 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:03.783 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:03.783 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.783 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.784 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.784 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:03.784 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.784 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:03.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:03.877 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:03.877 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:25:03.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:25:03.878 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:03.880 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:03.880 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:03.880 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:03.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.881 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.881 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:03.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.882 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:03.967 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:03.968 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:03.968 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:03.968 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:03.968 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:03.976 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:03.977 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:03.978 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:03.978 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:04.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:04.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:04.073 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 4 2020-02-08T18:25:04.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=21 2020-02-08T18:25:04.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 21 = 0 ']' 2020-02-08T18:25:04.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:04.075 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 302 + 21 2020-02-08T18:25:04.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=323 2020-02-08T18:25:04.076 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:04.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:08.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:08.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:08.079 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:08.081 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:08.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:08.084 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:08.084 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:08.085 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:08.085 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.085 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.085 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.085 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:08.085 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.086 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:08.181 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:08.181 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:08.181 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:08.182 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:08.182 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:08.190 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:08.191 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:08.191 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:08.191 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:08.191 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.191 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.191 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.192 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:08.192 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.192 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:08.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:08.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:08.287 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:25:08.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:08.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:08.290 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:08.291 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:08.291 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:08.291 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.291 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.292 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.292 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:08.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:08.376 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:08.376 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:08.376 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:25:08.377 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:08.377 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:08.385 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.385 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.386 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.386 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:08.386 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.386 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:08.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:08.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:08.481 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:25:08.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:25:08.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:08.483 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:08.483 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:08.483 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.484 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:08.484 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:08.573 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:08.573 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:08.573 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:08.573 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:08.573 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:08.587 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:08.587 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:08.587 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:08.587 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:08.587 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.588 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:08.588 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.588 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:08.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:08.679 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:08.679 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 3 2020-02-08T18:25:08.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:25:08.680 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:08.681 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:08.681 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:08.682 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:08.682 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.682 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.682 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.682 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.683 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:08.770 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:08.770 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:08.770 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:08.770 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:08.770 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:08.784 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.785 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:08.786 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.786 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:08.875 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:25:08.875 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:25:08.875 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 1 2020-02-08T18:25:08.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:08.876 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:08.877 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:08.878 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:08.878 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:08.878 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.878 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.878 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.878 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:08.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.879 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:08.966 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:08.966 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:08.966 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:08.967 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:08.967 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:08.975 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:08.975 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:08.975 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:08.976 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:08.976 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:08.976 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:08.976 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:08.976 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:08.976 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:08.977 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:09.071 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:09.072 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:09.072 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 3 2020-02-08T18:25:09.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:25:09.073 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:09.074 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:09.074 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:09.074 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:09.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:09.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:09.075 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:09.075 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:09.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:09.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:09.163 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:09.163 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:09.163 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:09.164 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:09.164 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:09.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:09.172 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:09.173 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:09.173 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:09.173 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:09.173 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:09.174 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:09.174 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:09.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:09.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:09.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:09.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:09.268 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:25:09.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:25:09.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 17 = 0 ']' 2020-02-08T18:25:09.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:09.270 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 323 + 17 2020-02-08T18:25:09.271 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=340 2020-02-08T18:25:09.271 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:09.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:13.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:13.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:13.275 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:13.286 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:13.286 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:13.286 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:13.286 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:13.286 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:13.286 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.287 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.287 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.287 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:13.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.287 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:13.376 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:13.376 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:13.376 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:13.376 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:13.376 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:13.386 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:13.386 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:13.386 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.387 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:13.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:13.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:25:13.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:25:13.481 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 1 2020-02-08T18:25:13.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=1 2020-02-08T18:25:13.482 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:13.483 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:13.483 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:13.484 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:13.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.484 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:13.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.485 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:13.576 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:13.577 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:13.577 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:13.577 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:13.577 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:13.580 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:13.580 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:13.581 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:13.581 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:13.581 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.581 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.581 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.582 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:13.582 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.582 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:13.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:25:13.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:25:13.676 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 1 + 1 2020-02-08T18:25:13.677 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:13.677 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:13.679 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:13.679 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:13.680 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:13.680 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.680 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.680 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.681 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:13.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:13.766 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:13.767 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:13.767 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:13.767 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:13.767 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:13.775 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.776 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:13.777 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.777 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:13.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:13.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:13.870 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 3 2020-02-08T18:25:13.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:25:13.871 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.873 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:13.874 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.874 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:13.961 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:13.961 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:13.961 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:13.961 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:13.961 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:13.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:13.969 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:13.969 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:13.969 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:13.969 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:13.970 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:13.970 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:13.970 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:13.970 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:13.970 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:14.065 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:25:14.065 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:25:14.065 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 1 2020-02-08T18:25:14.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:25:14.066 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:14.067 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:14.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:14.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:14.068 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:14.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:14.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:14.069 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:14.156 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:14.156 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:14.156 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:14.156 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:14.156 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:14.165 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:14.165 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:14.166 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:14.166 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:14.166 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:14.166 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:14.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:14.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:14.261 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 4 2020-02-08T18:25:14.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:14.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:14.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:14.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:14.264 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:14.350 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:14.350 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:14.351 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:14.351 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:14.351 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:14.358 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:14.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:14.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:14.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:14.360 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:14.361 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:14.361 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:14.362 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:14.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:14.362 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:14.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:14.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:14.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:25:14.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:25:14.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 14 = 0 ']' 2020-02-08T18:25:14.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:14.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 340 + 14 2020-02-08T18:25:14.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=354 2020-02-08T18:25:14.459 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:14.460 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:18.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:18.463 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:18.463 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:18.466 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:18.466 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:18.466 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:18.466 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:18.466 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:18.467 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:18.467 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:18.468 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:18.468 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:18.468 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:18.468 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:18.565 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:18.565 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:18.565 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:18.565 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:18.565 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:18.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:18.574 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:18.574 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:18.575 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:18.576 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:18.576 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:18.671 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:18.671 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:18.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:25:18.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:18.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:18.674 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:18.674 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:18.674 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:18.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:18.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:18.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:18.675 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:18.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:18.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:18.762 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:18.762 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:18.762 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:25:18.763 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:18.763 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:18.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:18.773 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:18.774 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:18.774 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:18.774 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:18.774 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:18.774 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:18.774 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:18.775 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:18.775 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:18.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:18.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:18.866 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 2 2020-02-08T18:25:18.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:25:18.867 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:18.868 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:18.868 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:18.868 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:18.868 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:18.869 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:18.869 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:18.869 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:18.869 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:18.870 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:18.956 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:18.956 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:18.956 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:18.957 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:18.957 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:18.965 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:18.966 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:18.967 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:18.967 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:18.967 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:18.967 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:18.967 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:18.968 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:18.968 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:18.968 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:19.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:19.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:19.061 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:25:19.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:25:19.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:19.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:19.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:19.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:19.151 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:19.152 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:19.152 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:19.152 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:19.152 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:19.161 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:19.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:19.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:19.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:19.161 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:19.161 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:19.162 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:19.162 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:19.162 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:19.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:19.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:19.257 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:25:19.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:19.258 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:19.259 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:19.259 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:19.259 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:19.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:19.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:19.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:19.260 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:19.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:19.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:19.347 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:19.347 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:19.347 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:19.348 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:19.348 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:19.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:19.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:19.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:19.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:19.357 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:19.359 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:19.359 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:19.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:19.360 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:19.360 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:19.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:19.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:19.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:25:19.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:25:19.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:19.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:19.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:19.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:19.455 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:19.455 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:19.456 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:19.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:19.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:19.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:19.545 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:19.545 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:19.545 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:19.545 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:19.545 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:19.551 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:19.552 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:19.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:19.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:19.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:19.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:19.646 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:25:19.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:25:19.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:25:19.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:19.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 354 + 18 2020-02-08T18:25:19.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=372 2020-02-08T18:25:19.649 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:19.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:23.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:23.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:23.653 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:23.654 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:23.655 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:23.664 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:23.664 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:23.664 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:23.664 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:23.664 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:23.665 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:23.665 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:23.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:23.665 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:23.755 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:23.755 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:23.756 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:23.756 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:23.756 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:23.765 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:23.765 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:23.765 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:23.765 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:23.765 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:23.765 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:23.766 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:23.766 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:23.766 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:23.766 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:23.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:23.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:23.862 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:25:23.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:23.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:23.864 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:23.864 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:23.864 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:23.864 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:23.864 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:23.864 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:23.865 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:23.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:23.865 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:23.953 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:23.953 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:23.953 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:25:23.953 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:23.953 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:23.962 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:23.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:23.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:23.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:23.962 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:23.963 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:23.963 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:23.963 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:23.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:23.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:24.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:24.057 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:24.058 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 2 2020-02-08T18:25:24.058 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:25:24.059 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:24.060 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:24.060 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:24.060 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:24.060 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.060 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.061 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.061 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:24.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:24.149 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:24.149 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:24.149 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:24.149 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:24.149 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:24.159 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:24.160 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:24.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:24.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:24.161 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.161 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.161 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.162 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:24.162 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.162 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:24.253 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:24.253 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:24.254 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:25:24.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:25:24.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:24.256 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:24.256 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:24.256 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.257 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:24.344 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:24.345 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:24.345 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:24.345 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:24.345 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:24.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:24.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:24.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:24.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:24.354 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.354 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.354 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.354 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:24.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:24.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:24.450 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:24.450 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:25:24.451 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:24.451 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:24.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:24.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:24.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:24.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:24.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.494 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:24.542 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:24.542 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:24.542 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:24.543 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:24.543 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:24.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:24.552 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:24.552 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:24.552 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:24.552 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.553 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.553 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:24.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:24.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:24.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:24.647 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:25:24.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:25:24.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:24.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:24.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:24.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:24.650 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.651 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:24.739 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:24.739 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:24.739 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:24.739 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:24.739 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:24.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:24.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:24.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:24.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:24.749 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:24.749 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:24.750 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:24.750 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:24.750 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:24.750 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:24.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:24.844 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:24.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:25:24.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:25:24.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:25:24.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:24.847 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 372 + 18 2020-02-08T18:25:24.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=390 2020-02-08T18:25:24.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:24.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:28.850 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:28.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:28.851 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:28.853 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:28.854 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:28.855 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:28.855 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:28.855 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:28.856 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:28.856 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:28.856 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:28.856 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:28.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:28.857 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:28.953 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:28.953 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:28.954 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:28.954 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:28.954 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:28.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:28.963 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:28.963 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:28.963 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:28.964 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:28.964 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:28.964 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:28.964 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:28.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:28.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:29.059 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:29.059 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:29.060 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:25:29.060 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:29.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:29.062 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:29.062 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:29.062 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:29.062 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:29.063 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.064 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:29.151 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:29.151 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:29.151 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:25:29.151 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:29.151 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:29.159 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:29.159 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:29.159 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:29.159 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:29.160 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.160 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.160 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.160 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:29.160 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.161 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:29.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:29.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:29.256 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 2 2020-02-08T18:25:29.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:25:29.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:29.258 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:29.258 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:29.258 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:29.258 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.258 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.259 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:29.259 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.259 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:29.346 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:29.346 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:29.346 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:29.346 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:29.347 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:29.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:29.355 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:29.356 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:29.356 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.356 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.356 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.356 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:29.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.357 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:29.451 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:29.451 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:29.451 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:25:29.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:25:29.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:29.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:29.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:29.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:29.454 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.454 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:29.541 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:29.542 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:29.542 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:29.542 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:29.542 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:29.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:29.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:29.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:29.552 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:29.552 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.552 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.552 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:29.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:29.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:29.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:29.646 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:25:29.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:29.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:29.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:29.736 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:29.736 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:29.736 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:29.736 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:29.737 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:29.745 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:29.746 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:29.746 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:29.746 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:29.746 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.747 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.747 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.747 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:29.747 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.747 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:29.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:29.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:29.842 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:25:29.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:25:29.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:29.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:29.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:29.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:29.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:29.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:29.935 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:29.935 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:29.935 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:29.936 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:29.936 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:29.942 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:29.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:29.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:29.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:29.943 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:29.943 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:29.943 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:29.943 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:29.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:29.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:30.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:30.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:30.038 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:25:30.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:25:30.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:25:30.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:30.040 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 390 + 18 2020-02-08T18:25:30.040 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=408 2020-02-08T18:25:30.041 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:30.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:34.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:34.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:34.045 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:34.046 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:34.047 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:34.048 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:34.048 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:34.048 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:34.049 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.049 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.049 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.049 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:34.050 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.050 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:34.146 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:34.146 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:34.146 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:34.146 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:34.147 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:34.155 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:34.155 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.156 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.157 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:34.157 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.157 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:34.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:34.267 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:34.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.268 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.269 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.269 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:34.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:34.345 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:34.345 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:34.345 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:25:34.345 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:34.346 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:34.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:34.355 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:34.355 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:34.355 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:34.356 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.356 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.356 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.356 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:34.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:34.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:34.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:34.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 2 2020-02-08T18:25:34.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:25:34.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:34.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:34.456 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:34.542 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:34.543 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:34.543 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:34.543 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:34.543 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:34.552 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:34.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:34.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:34.553 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:34.553 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.553 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.554 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.554 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:34.554 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.554 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:34.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:34.647 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:34.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:25:34.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:25:34.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:34.651 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:34.651 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:34.651 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:34.651 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.652 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.652 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.652 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:34.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:34.746 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:34.746 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:34.746 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:34.746 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:34.746 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:34.749 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:34.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:34.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:34.749 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:34.749 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.750 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.750 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.750 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:34.750 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.750 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:34.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:34.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:34.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:25:34.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:34.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:34.847 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:34.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:34.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:34.848 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.848 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.848 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:34.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.849 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:34.938 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:34.938 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:34.938 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:34.938 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:34.939 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:34.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:34.946 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:34.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:34.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:35.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:35.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:35.041 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:25:35.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:25:35.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:35.043 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:35.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:35.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:35.044 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:35.044 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:35.044 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:35.045 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:35.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:35.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:35.135 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:35.135 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:35.135 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:35.135 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:35.136 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:35.149 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:35.149 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:35.150 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:35.150 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:35.150 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:35.150 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:35.150 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:35.151 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:35.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:35.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:35.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:35.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:35.237 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 4 2020-02-08T18:25:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:25:35.238 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:25:35.239 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:35.239 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 408 + 18 2020-02-08T18:25:35.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=426 2020-02-08T18:25:35.240 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:35.241 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:39.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:39.243 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:39.244 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:39.246 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:39.247 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:39.248 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:39.248 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:39.248 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:39.249 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.249 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.249 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.249 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:39.249 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.250 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:39.347 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:39.347 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:39.348 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:39.348 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:39.348 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:39.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.357 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:39.358 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.358 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:39.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:39.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:39.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:25:39.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:25:39.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:39.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.458 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:39.554 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:39.554 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:39.554 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:39.554 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:39.554 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.555 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:39.556 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.556 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:39.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:39.649 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:39.649 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 3 2020-02-08T18:25:39.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:25:39.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:39.651 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:39.652 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:39.652 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.652 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:39.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:39.741 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:39.741 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:39.742 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:39.742 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:39.742 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:39.751 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:39.751 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:39.751 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:39.751 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:39.752 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.752 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.752 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.752 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:39.752 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.752 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:39.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:39.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:39.847 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 3 2020-02-08T18:25:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:25:39.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:39.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:39.850 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:39.850 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.850 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.851 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:39.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.851 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:39.937 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:39.937 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:39.938 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:39.938 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:39.938 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:39.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:39.947 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:39.948 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:39.948 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:39.948 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:39.948 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:40.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:25:40.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:25:40.042 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 1 2020-02-08T18:25:40.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:40.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:40.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:40.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:40.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:40.044 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:40.044 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:40.044 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:40.045 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:40.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:40.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:40.132 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:40.132 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:40.132 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:40.132 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:40.132 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:40.141 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:40.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:40.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:40.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:40.141 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:40.142 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:40.142 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:40.142 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:40.142 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:40.142 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:40.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:40.236 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:40.236 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 4 2020-02-08T18:25:40.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:25:40.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:40.238 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:40.238 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:40.238 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:40.239 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:40.239 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:40.239 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:40.239 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:40.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:40.240 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:40.326 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:40.327 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:40.327 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:40.327 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:40.327 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:40.336 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:40.336 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:40.337 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:40.337 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:40.337 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:40.337 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:40.338 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:40.338 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:40.338 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:40.338 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:40.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:40.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:40.436 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 2 2020-02-08T18:25:40.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=16 2020-02-08T18:25:40.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 16 = 0 ']' 2020-02-08T18:25:40.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:40.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 426 + 16 2020-02-08T18:25:40.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=442 2020-02-08T18:25:40.438 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:40.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:44.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:44.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:44.445 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:44.445 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:44.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:44.446 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:44.446 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:44.446 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:44.446 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:44.447 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:44.447 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:44.447 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:44.447 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:44.448 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:44.540 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:44.540 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:44.541 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:44.541 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:44.541 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:44.550 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:44.550 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:44.550 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:44.550 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:44.550 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:44.551 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:44.551 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:44.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:44.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:44.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:44.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:44.646 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:44.647 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:25:44.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:25:44.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:44.649 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:44.649 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:44.650 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:44.738 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:44.739 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:44.739 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:44.739 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:44.739 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:44.747 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:44.747 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:44.747 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:44.747 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:44.748 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:44.748 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:44.748 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:44.748 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:44.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:44.748 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:44.842 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:44.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:44.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 4 2020-02-08T18:25:44.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:25:44.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:44.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:44.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:44.846 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:44.846 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:44.847 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:44.847 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:44.847 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:44.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:44.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:44.934 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:44.934 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:44.934 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:44.934 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:44.934 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:44.942 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:44.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:44.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:44.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:44.943 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:44.943 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:44.943 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:44.943 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:44.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:44.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:45.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:45.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:45.038 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 3 2020-02-08T18:25:45.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:25:45.039 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:45.040 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:45.040 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:45.040 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:45.040 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:45.041 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:45.041 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:45.041 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:45.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:45.041 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:45.127 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:45.127 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:45.127 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:45.127 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:45.127 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:45.137 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:45.138 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:45.138 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:45.138 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:45.138 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:45.138 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:45.138 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:45.139 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:45.139 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:45.139 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:45.231 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:45.231 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:45.232 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 3 2020-02-08T18:25:45.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:25:45.233 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:45.234 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:45.234 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:45.234 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:45.234 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:45.235 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:45.235 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:45.235 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:45.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:45.235 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:45.322 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:45.322 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:45.322 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:45.323 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:45.323 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:45.331 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:45.331 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:45.331 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:45.331 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:45.332 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:45.332 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:45.332 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:45.332 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:45.332 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:45.332 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:45.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:45.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:45.427 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 4 2020-02-08T18:25:45.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:25:45.428 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:45.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:45.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:45.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:45.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:45.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:45.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:45.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:45.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:45.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:45.517 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:45.517 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:45.518 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:45.518 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:45.518 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:45.526 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:45.526 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:45.527 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:45.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:45.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:45.623 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 17 + 4 2020-02-08T18:25:45.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=21 2020-02-08T18:25:45.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 21 = 0 ']' 2020-02-08T18:25:45.624 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:45.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 442 + 21 2020-02-08T18:25:45.625 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=463 2020-02-08T18:25:45.625 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:45.626 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:49.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:49.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:49.629 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:49.630 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:49.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:49.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:49.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:49.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:49.633 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:49.633 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:49.633 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:49.633 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:49.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:49.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:49.732 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:49.732 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:49.732 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:49.732 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:49.733 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:49.742 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:49.742 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:49.743 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:49.744 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:49.744 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:49.745 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:49.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:49.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:49.838 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:25:49.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:25:49.841 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:49.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:49.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:49.842 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:49.842 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:49.842 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:49.842 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:49.843 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:49.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:49.843 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:49.928 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:49.928 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:49.928 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:49.929 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:49.929 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:49.937 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:49.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:49.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:49.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:49.937 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:49.938 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:49.938 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:49.938 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:49.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:49.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:50.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:50.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:50.032 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 3 2020-02-08T18:25:50.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:25:50.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:50.035 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:50.035 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:50.035 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:50.035 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.035 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.036 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.036 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:50.036 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.036 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:50.121 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:50.122 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:50.122 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:50.122 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:50.122 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.138 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.139 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:50.139 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.139 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:50.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:50.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:50.227 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 2 2020-02-08T18:25:50.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:25:50.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:50.229 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:50.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:50.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:50.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:50.231 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.231 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:50.318 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:50.318 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:50.318 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:25:50.318 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:50.318 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:50.335 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:50.335 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:50.335 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:50.335 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:50.335 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.335 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.336 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.336 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:50.336 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.336 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:50.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:50.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:50.424 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:25:50.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:25:50.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:50.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:50.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:50.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:50.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:50.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:50.517 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:50.517 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:50.517 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:25:50.517 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:50.517 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:50.527 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:50.527 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:50.527 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:50.527 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:50.528 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.528 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.528 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.528 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:50.528 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.528 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:50.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:50.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:50.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 3 2020-02-08T18:25:50.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:25:50.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:50.625 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.625 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:50.714 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:50.714 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:50.714 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:50.714 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:50.715 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:50.722 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:50.722 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:50.722 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:50.723 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:50.723 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:50.723 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:50.723 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:50.724 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:50.724 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:50.724 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:50.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:50.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:50.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 3 2020-02-08T18:25:50.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:25:50.820 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:25:50.820 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:50.821 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 463 + 15 2020-02-08T18:25:50.821 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=478 2020-02-08T18:25:50.821 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:50.822 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:25:54.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:25:54.824 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:25:54.825 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:25:54.826 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:25:54.827 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:54.835 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:54.835 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:54.835 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:54.837 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:54.838 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:54.845 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:54.845 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:54.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:54.845 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:54.926 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:54.926 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:54.926 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:54.927 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:54.927 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:54.935 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:54.935 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:25:54.936 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:25:54.936 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:25:54.936 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:54.937 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:54.937 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:54.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:25:54.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:54.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:25:55.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:55.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:55.033 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:25:55.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:25:55.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:55.035 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:55.036 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:55.036 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:55.036 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.036 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.036 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.036 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:55.037 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.038 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:55.123 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:55.123 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:25:55.123 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:55.124 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:55.124 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:55.132 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:55.132 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:25:55.132 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:25:55.132 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:25:55.132 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.132 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.133 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.133 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:25:55.133 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.133 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:25:55.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:55.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:55.228 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 4 2020-02-08T18:25:55.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:25:55.229 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:55.231 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:55.231 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:55.231 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:55.231 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.232 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.232 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.232 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:55.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.232 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:55.320 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:55.320 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:55.320 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:55.320 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:55.321 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:55.329 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:55.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:25:55.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:25:55.330 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:25:55.330 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.330 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.330 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.330 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:25:55.331 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.331 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:25:55.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:55.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:55.425 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:25:55.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:25:55.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:55.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:55.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:55.431 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:55.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.431 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:55.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:55.515 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:55.515 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:55.515 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:25:55.515 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:55.516 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:55.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:55.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:25:55.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:25:55.524 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:25:55.524 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.525 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.525 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:25:55.525 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.525 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:25:55.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:25:55.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:25:55.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 2 2020-02-08T18:25:55.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:25:55.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:55.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:55.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:55.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:55.623 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.623 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.623 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.623 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:55.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.624 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:55.711 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:55.711 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:25:55.711 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:25:55.711 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:55.712 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:55.721 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:55.721 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:25:55.724 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:25:55.724 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:25:55.725 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.727 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.727 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.728 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:25:55.728 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.728 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:25:55.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:25:55.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:25:55.816 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 4 2020-02-08T18:25:55.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:25:55.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:25:55.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:55.819 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:55.819 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:55.819 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.819 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.820 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.820 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:55.820 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.821 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:55.906 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:25:55.906 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:25:55.906 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:25:55.906 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:25:55.906 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:25:55.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:25:55.916 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:25:55.916 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:25:55.916 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:25:55.916 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:25:55.917 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:25:55.917 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:25:55.917 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:25:55.918 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:25:55.918 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:25:56.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:25:56.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:25:56.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 15 + 3 2020-02-08T18:25:56.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:25:56.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:25:56.011 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:25:56.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 478 + 18 2020-02-08T18:25:56.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=496 2020-02-08T18:25:56.014 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:25:56.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:00.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:00.016 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:00.017 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:00.018 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:00.019 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:00.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:00.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:00.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:00.021 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.022 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.022 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.022 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:00.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:00.118 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:00.119 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:26:00.119 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:00.119 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:00.119 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:00.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.128 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.129 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.129 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:00.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:00.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:00.225 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:00.226 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:26:00.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:26:00.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:00.229 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:00.229 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:00.229 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:00.229 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.230 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:00.316 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:00.316 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:26:00.316 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:00.316 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:00.317 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:00.328 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.328 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.329 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:00.329 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.329 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:00.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:00.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:00.423 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 4 2020-02-08T18:26:00.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:00.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:00.425 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:00.425 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:00.425 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:00.426 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.426 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.426 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.426 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:00.426 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:00.513 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:00.514 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:00.514 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:00.514 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:00.514 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:00.522 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:00.522 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:00.522 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:00.522 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:00.522 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.523 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.523 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.523 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:00.523 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.523 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:00.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:00.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:00.616 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:00.617 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:00.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:00.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:00.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:00.620 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:00.620 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.620 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.620 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.621 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:00.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.621 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:00.709 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:00.709 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:00.709 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:00.709 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:00.710 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:00.718 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:00.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:00.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:00.718 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:00.719 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.719 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.719 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.719 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:00.720 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.720 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:00.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:00.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:00.813 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 2 2020-02-08T18:26:00.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:26:00.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:00.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:00.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:00.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:00.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.818 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.819 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:00.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.819 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:00.904 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:00.904 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:00.904 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:00.904 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:00.905 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:00.913 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:00.913 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:00.913 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:00.913 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:00.914 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:00.914 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:00.914 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:00.914 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:00.914 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:00.914 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:01.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:01.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:01.010 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 4 2020-02-08T18:26:01.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:26:01.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:01.011 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:01.011 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:01.012 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:01.012 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:01.013 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:01.013 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:01.013 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:01.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:01.013 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:01.101 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:01.101 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:01.101 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:01.101 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:01.101 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:01.108 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:01.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:01.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:01.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:01.108 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:01.109 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:01.109 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:01.109 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:01.109 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:01.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:01.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:01.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:01.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 15 + 3 2020-02-08T18:26:01.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:26:01.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:26:01.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:01.205 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 496 + 18 2020-02-08T18:26:01.205 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=514 2020-02-08T18:26:01.206 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:01.207 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:05.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:05.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:05.210 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:05.212 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:05.213 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:05.214 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:05.214 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:05.215 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:05.215 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.215 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.215 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.215 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:05.215 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:05.312 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:05.312 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:05.312 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:05.313 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:05.313 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:05.320 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:05.320 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:05.321 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.322 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:05.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:05.417 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:05.417 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:26:05.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:26:05.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:05.420 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:05.420 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:05.421 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:05.421 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.421 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.421 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.422 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:05.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.422 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:05.508 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:05.508 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:05.508 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:05.508 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:05.509 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:05.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:05.517 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:05.517 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:05.517 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:05.518 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.518 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.519 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:05.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.520 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:05.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:05.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:05.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 4 2020-02-08T18:26:05.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:05.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:05.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.619 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:05.703 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:05.703 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:05.703 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:05.703 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:05.704 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:05.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:05.712 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:05.712 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:05.712 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:05.712 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.712 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.712 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.713 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:05.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:05.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:05.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:05.811 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:26:05.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:26:05.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.812 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:05.813 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.818 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:05.897 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:05.897 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:05.898 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:05.898 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:05.898 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:05.907 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:05.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:05.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:05.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:06.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:06.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:06.002 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 2 2020-02-08T18:26:06.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:26:06.003 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:06.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:06.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:06.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:06.006 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:06.006 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:06.006 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:06.006 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:06.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:06.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:06.093 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:06.093 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:26:06.093 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:06.093 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:06.094 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:06.102 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:06.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:06.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:06.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:06.103 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:06.103 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:06.103 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:06.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:06.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:06.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:06.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:06.203 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:06.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 2 2020-02-08T18:26:06.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:26:06.204 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:06.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:06.204 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:06.205 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:06.205 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:06.205 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:06.205 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:06.206 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:06.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:06.206 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:06.290 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:06.291 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:06.291 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:06.291 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:06.291 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:06.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:06.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:06.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:06.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:06.300 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:06.301 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:06.301 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:06.301 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:06.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:06.301 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:06.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:06.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:06.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 3 2020-02-08T18:26:06.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:26:06.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:26:06.398 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:06.398 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 514 + 15 2020-02-08T18:26:06.399 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=529 2020-02-08T18:26:06.401 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:06.401 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:10.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:10.402 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:10.403 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:10.404 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:10.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:10.408 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:10.408 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:10.408 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:10.408 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:10.408 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:10.409 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:10.409 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:10.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:10.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:10.504 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:10.505 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:10.505 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:10.505 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:10.505 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:10.517 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:10.517 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:10.517 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:10.517 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:10.517 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:10.518 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:10.518 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:10.518 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:10.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:10.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:10.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:10.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:10.610 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:26:10.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:26:10.611 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:10.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:10.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:10.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:10.614 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:10.615 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:10.615 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:10.615 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:10.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:10.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:10.701 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:10.701 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:26:10.701 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:10.701 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:10.702 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:10.715 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:10.715 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:10.715 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:10.715 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:10.716 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:10.716 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:10.716 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:10.716 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:10.716 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:10.717 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:10.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:10.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:10.805 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 3 2020-02-08T18:26:10.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:26:10.807 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:10.809 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:10.809 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:10.809 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:10.809 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:10.810 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:10.810 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:10.810 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:10.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:10.811 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:10.896 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:10.896 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:10.897 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:10.897 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:10.897 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:10.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:10.906 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:10.906 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:10.908 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:10.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:10.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:11.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:11.002 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:11.002 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 1 2020-02-08T18:26:11.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:26:11.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:11.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:11.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:11.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:11.005 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:11.006 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:11.006 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:11.006 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:11.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:11.007 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:11.091 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:11.092 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:11.092 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:11.092 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:11.092 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:11.103 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:11.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:11.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:11.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:11.103 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:11.104 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:11.104 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:11.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:11.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:11.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:11.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:26:11.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:26:11.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 0 2020-02-08T18:26:11.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:26:11.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:11.199 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:11.200 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:11.200 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:11.200 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:11.200 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:11.200 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:11.200 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:11.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:11.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:11.290 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:11.290 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:11.290 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:11.291 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:11.291 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:11.300 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:11.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:11.301 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:11.301 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:11.301 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:11.301 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:11.302 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:11.302 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:11.303 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:11.303 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:11.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:11.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:11.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 2 2020-02-08T18:26:11.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:26:11.397 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:11.399 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:11.399 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:11.399 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:11.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:11.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:11.400 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:11.400 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:11.400 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:11.401 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:11.486 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:11.486 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:11.486 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:11.486 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:11.486 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:11.497 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:11.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:11.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:11.497 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:11.497 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:11.498 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:11.498 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:11.498 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:11.498 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:11.498 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:11.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:11.589 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:11.590 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:26:11.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:11.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 9 = 0 ']' 2020-02-08T18:26:11.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:11.592 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 529 + 9 2020-02-08T18:26:11.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=538 2020-02-08T18:26:11.593 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:11.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:15.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:15.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:15.599 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:15.599 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:15.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:15.600 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:15.600 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:15.601 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:15.601 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:15.601 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:15.601 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:15.601 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:15.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:15.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:15.697 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:15.697 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:15.698 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:15.698 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:15.698 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:15.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:15.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:15.710 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:15.710 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:15.710 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:15.710 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:15.711 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:15.711 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:15.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:15.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:15.803 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:15.803 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:26:15.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:26:15.805 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:15.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:15.807 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:15.807 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:15.807 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:15.807 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:15.808 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:15.808 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:15.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:15.808 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:15.894 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:15.894 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 4, 2020-02-08T18:26:15.895 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:15.895 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:15.895 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:15.903 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:15.904 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:15.904 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:15.905 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:15.905 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:15.905 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:15.905 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:15.905 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:15.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:15.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:15.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:15.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:15.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 4 2020-02-08T18:26:15.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:16.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:16.000 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:16.000 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:16.001 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:16.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.009 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.009 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:16.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:16.089 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:16.090 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:16.090 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:16.090 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:16.090 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:16.099 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.099 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.100 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.100 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:16.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:16.193 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:16.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:16.194 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 1 2020-02-08T18:26:16.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:26:16.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:16.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:16.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:16.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:16.197 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.198 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.198 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:16.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:16.284 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:16.284 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:16.284 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:16.285 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:16.285 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:16.293 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:16.293 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:16.293 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:16.293 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:16.293 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.294 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.295 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.295 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:16.295 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.295 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:16.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:16.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:16.389 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:26:16.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:16.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:16.391 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:16.391 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:16.391 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:16.392 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.392 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.392 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:16.392 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.393 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:16.479 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:16.479 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:16.479 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:16.479 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:16.480 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:16.488 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:16.489 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:16.489 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:16.489 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:16.489 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.489 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.489 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.490 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:16.490 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.490 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:16.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:16.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:16.584 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 2 2020-02-08T18:26:16.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:26:16.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:16.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:16.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:16.595 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:16.595 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:16.677 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:16.677 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:16.677 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:16.677 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:16.677 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:16.685 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:16.685 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:16.686 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:16.686 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:16.686 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:16.686 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:16.687 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:16.687 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:16.687 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:16.687 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:16.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:16.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:16.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 1 2020-02-08T18:26:16.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:26:16.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 12 = 0 ']' 2020-02-08T18:26:16.783 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:16.783 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 538 + 12 2020-02-08T18:26:16.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=550 2020-02-08T18:26:16.785 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:16.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:20.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:20.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:20.788 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:20.790 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:20.791 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:20.792 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:20.792 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:20.793 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:20.793 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:20.793 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:20.794 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:20.889 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:20.889 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:20.890 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:20.890 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:20.890 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:20.898 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:20.899 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:20.900 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:20.900 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:20.995 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:20.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:20.996 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 2 2020-02-08T18:26:20.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=2 2020-02-08T18:26:20.997 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:20.998 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:20.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.000 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:21.087 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:21.087 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:26:21.087 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:21.088 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:21.088 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:21.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:21.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:21.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:21.098 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:21.098 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.098 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.098 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.098 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:21.099 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.099 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:21.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:21.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:21.193 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 2 + 4 2020-02-08T18:26:21.193 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:26:21.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:21.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:21.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:21.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:21.284 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:21.285 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:21.285 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:21.285 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:21.285 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:21.294 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:21.294 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:21.294 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:21.295 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:21.295 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.295 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.296 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.296 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:21.296 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.296 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:21.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:21.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:21.390 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 1 2020-02-08T18:26:21.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:21.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:21.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:21.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:21.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:21.393 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.393 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.393 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.393 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:21.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:21.478 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:21.478 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:26:21.478 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:21.479 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:21.479 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:21.487 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:21.487 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:21.487 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:21.487 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:21.488 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.488 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.488 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.488 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:21.489 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.489 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:21.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:21.583 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:21.583 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:21.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:21.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:21.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.587 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:21.673 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:21.674 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:21.674 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:21.674 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:21.674 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:21.683 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:21.683 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:21.683 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:21.683 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:21.683 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.683 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.684 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.684 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:21.684 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.684 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:21.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:21.778 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:21.778 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 1 2020-02-08T18:26:21.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:26:21.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:21.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:21.788 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.789 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:21.868 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:21.869 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:21.869 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:21.869 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:21.869 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:21.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:21.882 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:21.883 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:21.883 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:21.883 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:21.974 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:21.974 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:21.975 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 2 2020-02-08T18:26:21.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:26:21.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 12 = 0 ']' 2020-02-08T18:26:21.976 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:21.977 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 550 + 12 2020-02-08T18:26:21.977 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=562 2020-02-08T18:26:21.978 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:21.979 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:25.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:25.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:25.982 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:25.983 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:25.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:25.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:25.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:25.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:25.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:25.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:25.986 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:25.987 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:25.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:25.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:26.087 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:26.087 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:26.087 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:26.088 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:26.090 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:26.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:26.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:26.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:26.188 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:26.189 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:26:26.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:26:26.190 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:26.192 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:26.192 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:26.192 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:26.192 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.193 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.193 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.193 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:26.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.194 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:26.279 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:26.279 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:26:26.279 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:26.280 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:26.280 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:26.288 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:26.289 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:26.289 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:26.289 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:26.289 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.290 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.290 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.290 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:26.290 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.290 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:26.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:26.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:26.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 4 2020-02-08T18:26:26.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:26:26.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:26.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:26.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:26.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:26.389 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.389 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.389 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.389 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:26.390 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:26.474 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:26.474 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:26.474 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:26.475 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:26.475 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:26.483 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:26.483 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:26.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:26.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:26.484 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.484 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.484 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.484 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:26.485 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.485 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:26.578 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:26.579 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:26.579 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:26:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:26.580 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:26.585 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:26.585 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:26.669 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:26.670 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:26:26.670 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:26.670 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:26.670 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:26.680 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:26.680 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.681 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:26.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:26.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:26.780 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:26:26.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:26:26.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:26.780 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:26.781 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.782 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:26.864 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:26.864 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:26.865 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:26.865 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:26.873 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:26.873 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:26.873 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:26.874 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:26.874 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.874 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.874 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.874 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:26.874 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.875 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:26.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:26.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:26.968 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:26:26.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:26:26.970 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:26.973 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:26.973 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:26.974 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:26.974 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:26.974 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:26.974 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:26.975 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:26.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:26.975 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:27.059 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:27.060 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:27.060 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:27.060 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:27.060 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:27.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:27.069 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:27.069 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:27.069 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:27.069 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:27.069 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:27.070 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:27.070 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:27.070 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:27.070 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:27.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:27.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:27.167 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 15 + 3 2020-02-08T18:26:27.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:26:27.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:26:27.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:27.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 562 + 18 2020-02-08T18:26:27.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=580 2020-02-08T18:26:27.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:27.169 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:31.169 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:31.169 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:31.171 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:31.172 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:31.173 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:31.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:31.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:31.174 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:31.175 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.175 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.175 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.175 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:31.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.176 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:31.272 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:31.273 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:31.273 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:31.273 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:31.273 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:31.284 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:31.284 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:31.284 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.285 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:31.387 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:31.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:31.388 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:26:31.388 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:26:31.389 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:31.389 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:31.389 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:31.389 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:31.389 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.390 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.390 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:31.393 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:31.470 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:31.470 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:31.471 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:31.471 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:31.471 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:31.479 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.486 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.487 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:31.487 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.487 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:31.573 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:31.574 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:31.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 3 2020-02-08T18:26:31.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=6 2020-02-08T18:26:31.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:31.577 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:31.577 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:31.579 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:31.579 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.580 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.580 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.580 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:31.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.581 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:31.665 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:31.665 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:31.665 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:31.665 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:31.665 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:31.673 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.674 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:31.675 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.675 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:31.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:26:31.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:26:31.770 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 6 + 1 2020-02-08T18:26:31.772 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:31.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:31.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:31.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:31.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:31.774 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.774 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.774 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.774 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:31.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:31.860 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:31.861 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:26:31.861 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:31.861 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:31.861 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:31.870 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:31.870 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:31.870 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.871 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:31.966 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:31.966 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:31.967 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 4 2020-02-08T18:26:31.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=11 2020-02-08T18:26:31.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:31.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:31.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:31.970 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:31.970 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:31.970 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:31.970 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:31.970 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:31.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:31.971 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:32.057 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:32.057 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:32.062 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:32.062 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:32.062 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:32.065 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:32.066 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:32.070 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:32.070 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:32.070 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:32.071 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:32.071 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:32.071 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:32.080 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:32.080 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:32.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:32.163 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:32.194 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 11 + 2 2020-02-08T18:26:32.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:26:32.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:32.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:32.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:32.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:32.195 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:32.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:32.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:32.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:32.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:32.196 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:32.252 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:32.252 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:32.253 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:32.253 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:32.253 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:32.261 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:32.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:32.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:32.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:32.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:32.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:32.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:32.262 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:32.262 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:32.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:32.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:32.355 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:32.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:26:32.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:26:32.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 15 = 0 ']' 2020-02-08T18:26:32.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:32.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 580 + 15 2020-02-08T18:26:32.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=595 2020-02-08T18:26:32.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:32.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:36.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:36.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:36.362 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:36.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:36.365 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:36.366 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:36.366 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:36.366 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:36.373 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.373 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.373 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.373 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:36.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.374 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:36.463 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:36.463 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:36.463 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:26:36.463 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:36.464 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:36.472 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:36.472 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:36.472 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.473 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:36.474 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.474 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:36.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:36.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:36.571 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:26:36.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:26:36.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:36.573 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:36.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:36.574 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:36.574 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.574 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.574 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.575 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:36.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.575 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:36.667 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:36.667 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:36.667 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:36.667 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:36.668 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:36.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:36.672 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:36.672 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.673 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:36.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:36.770 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:36.770 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:26:36.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:36.771 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:36.772 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:36.772 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:36.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:36.773 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.773 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.773 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.773 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:36.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:36.860 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:36.860 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:36.860 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:36.861 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:36.861 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:36.869 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:36.869 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:36.869 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:36.869 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:36.869 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.870 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.870 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.870 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:36.870 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.871 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:36.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:36.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:36.965 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:36.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:36.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:36.967 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:36.967 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:36.967 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:36.968 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:36.968 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:36.968 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:36.968 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:36.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:36.969 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:37.056 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:37.056 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 4, 2020-02-08T18:26:37.057 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:37.057 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:37.057 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:37.066 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:37.066 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:37.066 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:37.067 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:37.067 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:37.067 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:37.067 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:37.067 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:37.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:37.068 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:37.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:37.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:37.160 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:26:37.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:26:37.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:37.163 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:37.164 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:37.164 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:37.164 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:37.164 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:37.165 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:37.165 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:37.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:37.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:37.251 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:37.251 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:37.252 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:37.252 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:37.252 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:37.261 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:37.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:37.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:37.261 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:37.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:37.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:37.262 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:37.262 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:37.262 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:37.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:37.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:37.356 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:37.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 2 2020-02-08T18:26:37.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=15 2020-02-08T18:26:37.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:37.358 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:37.358 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:37.358 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:37.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:37.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:37.359 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:37.360 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:37.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:37.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:37.447 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:37.447 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:37.447 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:37.448 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:37.448 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:37.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:37.458 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:37.458 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:37.458 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:37.459 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:37.459 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:37.459 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:37.459 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:37.459 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:37.460 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:37.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:37.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:37.553 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 15 + 2 2020-02-08T18:26:37.553 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=17 2020-02-08T18:26:37.553 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 17 = 0 ']' 2020-02-08T18:26:37.554 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:37.556 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 595 + 17 2020-02-08T18:26:37.556 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=612 2020-02-08T18:26:37.557 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:37.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:41.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:41.557 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:41.558 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:41.571 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:41.571 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:41.571 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:41.571 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:41.571 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:41.572 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:41.572 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:41.572 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:41.572 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:41.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:41.572 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:41.660 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:41.660 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:41.660 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:26:41.660 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:41.661 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:41.670 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:41.670 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:41.670 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:41.670 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:41.671 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:41.671 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:41.671 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:41.671 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:41.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:41.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:41.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:41.765 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:41.765 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:26:41.766 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:26:41.767 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:41.768 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:41.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:41.769 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:41.857 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:41.857 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:41.857 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:41.857 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:41.858 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:41.866 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:41.867 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:41.868 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:41.868 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:41.868 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:41.868 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:41.869 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:41.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:41.961 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:41.961 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:26:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:41.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:41.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:41.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:41.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:41.964 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:41.964 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:41.964 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:41.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:41.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:41.965 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:42.050 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:42.051 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:42.051 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:42.051 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:42.051 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:42.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:42.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:42.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:42.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:42.064 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.064 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.064 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.064 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:42.064 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.065 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:42.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:42.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:42.157 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:42.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:42.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:42.160 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:42.160 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:42.160 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:42.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.161 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.161 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:42.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:42.252 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:42.252 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 4, 2020-02-08T18:26:42.253 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:42.253 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:42.253 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:42.263 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:42.263 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:42.263 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:42.263 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:42.264 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.264 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.264 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.264 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:42.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:42.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:42.352 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:42.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:26:42.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:26:42.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:42.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:42.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:42.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:42.356 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.356 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.356 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.357 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:42.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.357 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:42.444 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:42.444 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:42.444 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:42.444 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:42.445 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:42.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:42.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:42.454 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:42.454 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:42.454 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.455 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.455 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.457 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:42.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.458 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:42.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:42.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:42.549 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 3 2020-02-08T18:26:42.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=16 2020-02-08T18:26:42.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:42.550 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:42.551 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.552 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:42.638 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:42.638 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:42.639 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:42.639 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:42.639 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:42.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:42.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:42.648 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:42.649 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:42.742 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:42.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:42.743 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 16 + 2 2020-02-08T18:26:42.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:26:42.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:26:42.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:42.745 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 612 + 18 2020-02-08T18:26:42.746 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=630 2020-02-08T18:26:42.747 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:42.747 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:46.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:46.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:46.750 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:46.752 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:46.755 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:46.755 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:46.755 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:46.755 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:46.756 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:46.756 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:46.756 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:46.756 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:46.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:46.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:46.852 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:46.852 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:46.852 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:26:46.853 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:46.853 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:46.862 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:46.862 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:46.862 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:46.862 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:46.863 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:46.863 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:46.863 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:46.866 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:46.866 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:46.867 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:46.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:46.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:46.959 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:26:46.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:26:46.960 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:46.962 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:46.962 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:46.962 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:46.962 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:46.963 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:46.963 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:46.963 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:46.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:46.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:47.048 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:47.049 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:47.049 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:47.049 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:47.049 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:47.058 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:47.058 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:47.058 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.059 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:47.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:47.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:47.155 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:26:47.155 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:47.156 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:47.157 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:47.157 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:47.158 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:47.158 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.158 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.159 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.159 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:47.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:47.246 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:47.246 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:47.246 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:47.246 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:47.246 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:47.258 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:47.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:47.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:47.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:47.259 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.259 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.260 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.260 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:47.260 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.260 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:47.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:47.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:47.350 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:47.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:47.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:47.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:47.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:47.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:47.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.353 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:47.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:47.440 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:47.441 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 4, 2020-02-08T18:26:47.441 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:47.441 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:47.441 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:47.451 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:47.452 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:47.452 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:47.452 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:47.452 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.453 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.453 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.453 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:47.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:47.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:47.544 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:47.545 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 4 2020-02-08T18:26:47.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=13 2020-02-08T18:26:47.546 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:47.548 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:47.548 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:47.548 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:47.548 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.548 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.549 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.549 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:47.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.549 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:47.635 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:47.635 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:47.636 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:47.636 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:47.636 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:47.644 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:47.645 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:47.645 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:47.645 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:47.646 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.646 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.646 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.646 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:47.646 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.647 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:47.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:47.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:47.743 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 13 + 3 2020-02-08T18:26:47.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=16 2020-02-08T18:26:47.743 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:47.743 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:47.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.745 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:47.830 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:47.830 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:47.830 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:47.831 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:47.831 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:47.839 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:47.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:47.840 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:47.840 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:47.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:47.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:47.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:47.840 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:47.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:47.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:47.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:47.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:47.935 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 16 + 2 2020-02-08T18:26:47.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=18 2020-02-08T18:26:47.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 18 = 0 ']' 2020-02-08T18:26:47.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:47.937 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 630 + 18 2020-02-08T18:26:47.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=648 2020-02-08T18:26:47.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:47.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:51.940 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:51.941 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:51.942 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:51.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:51.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:51.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:51.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:51.947 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:51.947 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:52.044 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:52.044 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:52.044 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:52.044 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:52.044 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:52.054 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:52.055 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:52.055 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:52.055 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:52.055 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.056 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.057 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:52.057 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.057 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:52.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:52.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:52.150 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:26:52.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:26:52.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:52.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:52.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:52.153 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:52.153 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.153 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.153 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.153 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:52.153 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:52.240 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:52.240 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:52.240 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:52.241 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:52.241 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:52.249 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:52.249 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:52.249 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.250 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:52.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:52.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:52.345 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 2 2020-02-08T18:26:52.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:26:52.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:52.347 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:52.348 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:52.348 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:52.348 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.348 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.348 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.348 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:52.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.349 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:52.438 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:52.438 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:52.438 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:52.438 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:52.438 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:52.445 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:52.445 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:52.446 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:52.446 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:52.446 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.446 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.446 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.446 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:52.447 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.447 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:52.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:52.541 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:52.541 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 2 2020-02-08T18:26:52.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:52.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:52.546 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:52.546 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:52.546 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:52.547 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.547 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.547 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.547 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:52.547 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.548 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:52.633 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:52.634 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:52.634 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:52.634 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:52.634 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:52.642 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:52.642 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:52.642 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:52.643 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:52.643 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.643 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.643 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.644 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:52.644 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.644 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:52.737 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:52.738 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:52.739 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:52.739 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:52.742 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:52.742 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:52.742 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:52.742 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.743 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.743 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.743 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:52.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.744 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:52.829 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:52.830 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:52.830 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:52.830 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:52.830 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:52.839 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:52.839 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.840 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.841 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:52.841 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.842 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:52.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:52.934 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:52.934 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 3 2020-02-08T18:26:52.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:26:52.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:52.937 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:52.937 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:52.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:52.938 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:52.938 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:52.938 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:52.938 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:52.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:52.939 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:53.026 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:53.026 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:53.026 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:53.026 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:53.026 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:53.035 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:53.035 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:53.035 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:53.035 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:53.035 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:53.035 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:53.036 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:53.036 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:53.036 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:53.036 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:53.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:26:53.130 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:26:53.130 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 0 2020-02-08T18:26:53.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:26:53.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 12 = 0 ']' 2020-02-08T18:26:53.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:53.132 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 648 + 12 2020-02-08T18:26:53.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=660 2020-02-08T18:26:53.133 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:53.134 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:26:57.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:26:57.136 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:26:57.137 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:26:57.138 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:26:57.139 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:57.140 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:57.140 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:57.141 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:57.141 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.142 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.142 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.142 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:57.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.142 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:57.237 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:57.238 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:57.238 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 4, 2020-02-08T18:26:57.238 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:57.238 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:57.247 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:57.247 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:26:57.248 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:26:57.248 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:26:57.248 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.248 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.249 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.249 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:26:57.249 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.249 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:26:57.342 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=4 2020-02-08T18:26:57.343 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 4 -gt 4 ']' 2020-02-08T18:26:57.343 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 4 2020-02-08T18:26:57.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:26:57.344 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:57.346 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:57.346 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:57.346 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:57.347 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.347 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.347 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.347 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:57.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.348 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:57.434 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:57.434 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 2, 2020-02-08T18:26:57.434 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:26:57.435 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:57.435 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:57.443 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:57.443 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:26:57.444 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:26:57.444 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:26:57.444 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.444 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.444 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.444 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:26:57.445 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.445 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:26:57.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:57.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:57.539 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 3 2020-02-08T18:26:57.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:26:57.540 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:57.540 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:57.540 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:57.540 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:57.541 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.541 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.541 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.541 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:57.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:57.628 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:57.628 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:57.628 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:26:57.629 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:57.629 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:57.637 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:57.637 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:26:57.638 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:26:57.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:57.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:57.734 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 2 2020-02-08T18:26:57.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:26:57.735 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:57.735 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:57.735 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:57.735 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:57.736 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.736 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.736 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.736 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:57.736 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.737 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:57.823 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:57.824 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:26:57.824 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:57.824 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:57.824 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:57.832 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:57.832 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:26:57.832 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:26:57.833 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:26:57.833 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.833 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.833 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.833 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:26:57.834 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.834 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:26:57.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:26:57.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:26:57.928 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 3 2020-02-08T18:26:57.928 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:26:57.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:57.930 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:57.931 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:57.931 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:57.931 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:57.931 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:57.932 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:57.932 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:57.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:57.932 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:58.018 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:58.018 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:58.018 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:26:58.019 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:58.019 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:58.026 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:58.028 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:26:58.028 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:26:58.028 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:26:58.028 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:58.029 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:58.029 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:58.029 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:26:58.029 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:58.030 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:26:58.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:26:58.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:26:58.123 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 2 2020-02-08T18:26:58.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:26:58.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:26:58.126 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:58.126 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:58.126 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:58.126 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:58.127 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:58.127 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:58.127 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:58.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:58.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:58.213 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:26:58.213 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:26:58.213 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:26:58.214 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:26:58.214 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:26:58.230 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:26:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:26:58.230 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:26:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:26:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:26:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:26:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:26:58.231 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:26:58.232 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:26:58.232 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:26:58.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:26:58.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:26:58.318 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 14 + 0 2020-02-08T18:26:58.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=14 2020-02-08T18:26:58.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 14 = 0 ']' 2020-02-08T18:26:58.319 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:26:58.320 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 660 + 14 2020-02-08T18:26:58.320 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=674 2020-02-08T18:26:58.320 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:26:58.321 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:02.322 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:02.323 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:02.324 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:02.325 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:02.326 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:02.327 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:02.327 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:02.327 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:02.328 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.328 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.329 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.329 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:02.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:02.427 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:02.427 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:02.427 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:27:02.427 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:02.427 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:02.436 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:02.437 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:02.437 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:02.437 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:02.437 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.437 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.437 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.438 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:02.438 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.438 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:02.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:02.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:02.534 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:27:02.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:27:02.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:02.536 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:02.537 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:02.537 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:02.537 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.537 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.538 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.538 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:02.538 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.539 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:02.626 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:02.626 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 1, 2020-02-08T18:27:02.626 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:02.626 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:02.627 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:02.635 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:02.636 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:02.636 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:02.636 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:02.636 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.637 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.645 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.645 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:02.645 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.646 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:02.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:27:02.729 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:27:02.730 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 2 2020-02-08T18:27:02.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:27:02.731 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:02.733 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:02.733 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:02.733 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:02.733 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.733 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.734 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.734 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:02.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:02.821 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:02.821 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:02.821 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:27:02.821 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:02.821 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:02.831 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:02.831 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:02.831 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:02.831 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:02.832 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.832 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.832 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.832 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:02.832 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.833 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:02.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:27:02.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:27:02.935 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 2 2020-02-08T18:27:02.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=7 2020-02-08T18:27:02.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:02.936 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:02.936 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:02.936 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:02.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:02.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:02.937 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:02.937 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:02.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:02.938 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:03.016 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:03.027 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:27:03.027 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:03.028 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:03.028 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:03.032 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:03.032 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:03.032 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:03.033 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:03.034 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:03.034 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:03.034 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:03.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:03.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:03.120 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 7 + 3 2020-02-08T18:27:03.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=10 2020-02-08T18:27:03.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:03.122 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:03.124 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:03.124 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:03.125 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:03.125 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:03.125 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:03.125 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:03.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:03.125 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:03.209 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 2, 2020-02-08T18:27:03.209 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:03.209 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:03.218 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:03.218 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:03.219 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:03.219 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:03.219 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:03.219 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:03.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=2 2020-02-08T18:27:03.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 2 -gt 4 ']' 2020-02-08T18:27:03.314 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 10 + 2 2020-02-08T18:27:03.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:27:03.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:03.317 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:03.317 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:03.317 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:03.317 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:03.317 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:03.317 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:03.318 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:03.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:03.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:03.404 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:03.405 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:03.405 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:03.405 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:03.405 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:03.414 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:03.415 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:03.415 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:03.415 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:03.415 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:03.416 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:03.416 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:03.416 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:03.416 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:03.416 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:03.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:03.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:03.512 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 12 + 0 2020-02-08T18:27:03.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=12 2020-02-08T18:27:03.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 12 = 0 ']' 2020-02-08T18:27:03.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:27:03.514 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 674 + 12 2020-02-08T18:27:03.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=686 2020-02-08T18:27:03.515 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:03.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:07.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:07.518 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:07.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:07.521 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:07.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:07.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:07.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:07.525 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:07.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:07.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:07.525 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:07.526 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:07.526 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:07.527 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:07.621 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:07.621 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:07.621 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:27:07.621 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:07.621 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:07.633 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:07.633 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:07.633 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:07.634 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:07.634 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:07.634 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:07.634 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:07.634 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:07.635 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:07.635 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:07.726 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:07.727 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:07.727 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:27:07.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:27:07.728 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:07.730 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:07.730 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:07.730 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:07.731 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:07.732 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:07.732 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:07.732 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:07.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:07.732 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:07.817 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:07.817 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:07.818 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:07.818 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:07.818 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:07.827 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:07.827 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:07.827 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:07.827 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:07.828 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:07.831 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:07.831 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:07.832 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:07.832 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:07.832 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:07.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:07.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:07.921 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 1 2020-02-08T18:27:07.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:27:07.922 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:07.926 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:07.926 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:07.927 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:07.927 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:07.927 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:07.927 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:07.928 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:07.928 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:07.928 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:08.012 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:08.012 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:08.012 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:08.012 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:08.012 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:08.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:08.021 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:08.021 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:08.021 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:08.021 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.022 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.022 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.022 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:08.022 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.022 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:08.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:08.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:08.116 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 1 2020-02-08T18:27:08.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:27:08.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:08.122 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:08.122 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:08.128 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:08.129 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.147 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.148 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.148 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:08.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:08.210 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:08.210 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:27:08.210 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:08.211 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:08.211 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:08.215 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.217 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:08.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:08.309 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:08.309 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:08.310 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 3 2020-02-08T18:27:08.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:27:08.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:08.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:08.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:08.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:08.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.313 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:08.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:08.401 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:08.401 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:08.401 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:08.401 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:08.402 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:08.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:08.413 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:08.413 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:08.413 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:08.414 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.414 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.414 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.414 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:08.414 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.415 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:08.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:08.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:08.507 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:27:08.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:27:08.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:08.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:08.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:08.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:08.511 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.512 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.512 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.512 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:08.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:08.599 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:08.600 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:08.600 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:08.600 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:08.600 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:08.607 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:08.607 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:08.608 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:08.608 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:08.608 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:08.608 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:08.608 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:08.608 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:08.609 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:08.609 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:08.702 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:08.702 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:08.703 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 0 2020-02-08T18:27:08.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:27:08.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 9 = 0 ']' 2020-02-08T18:27:08.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:27:08.704 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 686 + 9 2020-02-08T18:27:08.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=695 2020-02-08T18:27:08.706 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:08.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:12.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:12.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:12.710 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:12.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:12.712 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:12.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:12.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:12.714 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:12.714 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:12.714 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:12.715 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:12.715 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:12.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:12.716 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:12.811 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:12.811 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:12.811 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:27:12.812 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:12.812 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:12.821 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:12.822 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:12.822 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:12.822 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:12.822 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:12.823 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:12.823 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:12.824 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:12.824 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:12.824 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:12.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:12.919 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:12.919 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:27:12.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:27:12.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:12.924 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:12.924 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:12.924 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:12.925 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:12.925 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:12.925 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:12.925 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:12.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:12.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:13.011 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:13.011 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:13.012 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:13.012 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:13.013 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:13.019 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.020 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:13.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:13.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:13.115 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:13.116 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 1 2020-02-08T18:27:13.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:27:13.117 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:13.119 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:13.119 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:13.119 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:13.119 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.120 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:13.209 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:13.209 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:13.209 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:13.209 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:13.209 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:13.218 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:13.218 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:13.219 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:13.219 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:13.219 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.220 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.220 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.220 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:13.220 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.220 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:13.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:13.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:13.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 1 2020-02-08T18:27:13.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:27:13.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:13.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:13.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:13.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:13.315 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.316 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.316 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.316 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:13.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:13.406 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:13.406 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:27:13.406 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:13.407 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:13.407 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:13.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:13.413 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:13.414 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:13.414 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:13.414 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.415 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.415 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.415 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:13.415 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.415 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:13.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:13.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:13.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 3 2020-02-08T18:27:13.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:27:13.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:13.510 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:13.510 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:13.510 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:13.510 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.510 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.511 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:13.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:13.597 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:13.597 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:13.598 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:13.598 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:13.598 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:13.612 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:13.612 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:13.612 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:13.613 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:13.613 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.613 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.613 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.614 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:13.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:13.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:13.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:13.704 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:27:13.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:27:13.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:13.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:13.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:13.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:13.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:13.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:13.795 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:13.795 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:13.795 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:13.795 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:13.796 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:13.813 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:13.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:13.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:13.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:13.814 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:13.815 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:13.815 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:13.815 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:13.815 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:13.816 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:13.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:13.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:13.900 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 0 2020-02-08T18:27:13.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:27:13.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 9 = 0 ']' 2020-02-08T18:27:13.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:27:13.902 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 695 + 9 2020-02-08T18:27:13.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=704 2020-02-08T18:27:13.903 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:13.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:17.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:17.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:17.907 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:17.913 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:17.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:17.914 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:17.914 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:17.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:17.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:17.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:17.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:17.916 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:17.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:17.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:18.009 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:18.009 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:18.009 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 3, 2020-02-08T18:27:18.009 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:18.009 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:18.019 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:18.019 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:18.019 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:18.019 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:18.020 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.020 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.020 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.020 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:18.020 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.021 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:18.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:18.114 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:18.115 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 3 2020-02-08T18:27:18.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=3 2020-02-08T18:27:18.116 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.118 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.119 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.119 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:18.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:18.206 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:18.206 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:18.206 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:18.206 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:18.207 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:18.215 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:18.215 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.217 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:18.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:18.310 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:18.310 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:18.311 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 3 + 1 2020-02-08T18:27:18.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=4 2020-02-08T18:27:18.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:18.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:18.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:18.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:18.315 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.316 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.317 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.317 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:18.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.318 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:18.402 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:18.403 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:18.403 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:18.403 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:18.403 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:18.412 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:18.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:18.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:18.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:18.413 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.413 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.413 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.413 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:18.414 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.414 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:18.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:18.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:18.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 4 + 1 2020-02-08T18:27:18.513 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=5 2020-02-08T18:27:18.514 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:18.514 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:18.514 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:18.514 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:18.515 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.515 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.515 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.515 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:18.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.516 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:18.598 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:18.598 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 3, 2020-02-08T18:27:18.599 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:18.599 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:18.599 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:18.608 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:18.609 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:18.609 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:18.609 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:18.609 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.609 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.610 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.610 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:18.610 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.610 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:18.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=3 2020-02-08T18:27:18.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 3 -gt 4 ']' 2020-02-08T18:27:18.707 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 5 + 3 2020-02-08T18:27:18.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=8 2020-02-08T18:27:18.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:18.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:18.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:18.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:18.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:18.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:18.794 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:18.794 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:18.794 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 1, 2020-02-08T18:27:18.794 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:18.795 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:18.803 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:18.803 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:18.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:18.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:18.804 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.805 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.805 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.805 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:18.805 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:18.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=1 2020-02-08T18:27:18.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 1 -gt 4 ']' 2020-02-08T18:27:18.899 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 8 + 1 2020-02-08T18:27:18.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:27:18.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:18.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:18.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:18.912 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:18.913 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:18.913 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:18.915 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:18.915 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:18.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:18.915 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:18.993 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:18.993 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:18.993 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:18.993 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:18.994 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:19.001 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:19.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:19.002 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:19.003 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:19.003 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:19.003 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:19.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:19.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:19.096 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 9 + 0 2020-02-08T18:27:19.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=9 2020-02-08T18:27:19.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 9 = 0 ']' 2020-02-08T18:27:19.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 0 -gt 3 ']' 2020-02-08T18:27:19.098 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 704 + 9 2020-02-08T18:27:19.099 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=713 2020-02-08T18:27:19.099 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:19.100 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:23.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:23.102 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:23.103 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:23.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:23.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:23.107 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:23.107 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:23.107 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:23.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.108 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.108 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:23.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:23.205 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:23.205 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:23.205 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:23.206 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:23.206 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:23.215 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:23.215 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:23.215 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:23.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:23.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.216 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.216 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:23.216 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:23.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:23.314 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:23.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:23.315 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:23.315 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:23.316 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:23.316 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.316 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.316 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:23.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:23.403 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:23.403 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:23.403 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:23.403 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:23.403 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:23.412 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:23.412 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.413 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.413 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.413 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:23.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:23.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:23.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:23.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:23.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:23.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:23.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:23.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:23.511 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.512 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.512 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.512 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:23.526 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.526 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:23.598 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:23.599 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:23.599 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:23.600 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:23.600 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:23.608 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:23.608 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:23.609 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:23.609 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:23.609 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.609 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.610 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.610 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:23.610 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.610 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:23.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:23.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:23.704 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:23.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:23.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:23.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:23.711 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:23.712 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:23.712 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.712 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.712 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.713 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:23.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.713 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:23.794 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:23.794 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:23.794 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:23.794 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:23.795 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:23.803 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:23.803 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:23.803 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:23.803 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:23.804 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.804 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.804 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:23.804 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.805 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:23.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:23.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:23.900 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:23.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:23.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:23.902 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:23.902 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:23.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:23.991 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:24.000 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:24.000 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:24.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:24.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:24.001 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:24.001 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:24.001 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:24.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:24.002 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:24.002 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:24.095 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:24.095 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:24.096 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:24.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:24.103 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:24.103 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:24.103 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:24.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:24.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:24.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:24.104 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:24.104 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:24.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:24.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:24.186 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:24.187 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:24.187 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:24.187 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:24.187 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:24.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:24.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:24.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:24.196 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:24.197 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:24.197 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:24.197 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:24.197 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:24.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:24.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:24.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:24.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:24.291 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:24.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:24.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 0 = 0 ']' 2020-02-08T18:27:24.294 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: expr 0 + 1 2020-02-08T18:27:24.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: zerocount=1 2020-02-08T18:27:24.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 1 -gt 3 ']' 2020-02-08T18:27:24.295 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 713 + 0 2020-02-08T18:27:24.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=713 2020-02-08T18:27:24.296 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:24.296 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:28.298 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:28.299 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:28.300 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:28.311 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:28.311 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:28.311 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:28.311 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:28.311 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:28.311 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.312 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.312 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:28.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.312 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:28.400 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:28.401 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:28.401 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:28.401 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:28.401 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:28.411 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:28.411 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.412 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:28.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:28.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:28.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:28.507 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:28.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:28.509 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:28.510 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:28.510 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:28.510 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:28.510 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.511 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.511 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.511 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:28.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:28.598 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:28.598 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:28.598 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:28.598 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:28.598 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:28.607 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:28.607 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:28.607 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:28.608 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:28.608 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.608 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.608 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.608 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:28.609 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.609 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:28.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:28.708 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:28.708 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.710 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.710 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:28.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:28.795 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:28.795 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:28.795 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:28.795 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:28.796 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:28.804 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:28.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:28.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:28.805 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:28.805 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.805 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.805 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.805 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:28.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:28.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:28.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:28.899 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:28.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:28.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:28.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:28.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:28.910 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:28.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:28.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:28.911 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:28.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:28.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:28.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:28.990 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:28.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:28.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:28.991 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:28.991 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:29.001 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:29.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:29.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:29.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:29.002 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:29.002 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:29.002 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:29.002 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:29.002 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:29.003 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:29.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:29.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:29.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:29.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:29.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:29.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:29.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:29.100 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:29.100 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:29.100 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:29.100 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:29.101 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:29.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:29.101 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:29.188 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:29.188 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:29.188 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:29.188 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:29.189 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:29.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:29.197 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:29.198 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:29.198 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:29.198 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:29.198 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:29.199 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:29.199 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:29.199 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:29.199 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:29.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:29.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:29.292 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:29.293 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:29.293 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:29.298 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:29.298 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:29.298 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:29.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:29.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:29.299 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:29.299 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:29.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:29.300 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:29.384 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:29.384 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:29.384 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:29.384 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:29.384 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:29.393 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:29.393 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:29.393 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:29.394 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:29.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:29.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:29.490 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:29.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:29.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 0 = 0 ']' 2020-02-08T18:27:29.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: expr 1 + 1 2020-02-08T18:27:29.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: zerocount=2 2020-02-08T18:27:29.492 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 2 -gt 3 ']' 2020-02-08T18:27:29.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 713 + 0 2020-02-08T18:27:29.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=713 2020-02-08T18:27:29.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:29.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:33.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:33.497 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:33.498 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:33.499 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:33.500 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:33.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:33.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:33.503 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:33.503 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:33.503 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:33.504 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:33.504 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:33.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:33.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:33.599 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:33.599 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:33.600 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:33.600 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:33.600 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:33.609 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:33.609 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:33.610 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:33.611 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:33.611 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:33.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:33.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:33.706 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:33.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:33.707 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:33.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:33.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:33.709 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:33.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:33.709 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:33.710 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:33.710 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:33.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:33.710 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:33.798 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:33.799 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:33.799 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:33.799 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:33.799 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:33.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:33.806 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:33.806 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:33.807 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:33.808 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:33.809 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:33.809 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:33.809 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:33.809 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:33.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:33.901 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:33.902 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:33.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:33.902 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:33.904 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:33.904 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:33.905 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:33.905 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:33.905 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:33.906 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:33.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:33.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:33.906 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:33.990 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:33.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:33.991 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:33.991 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:33.991 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:34.000 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:34.000 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:34.000 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:34.000 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.001 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:34.001 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.002 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:34.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:34.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:34.095 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:34.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:34.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:34.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:34.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:34.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:34.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.098 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:34.185 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:34.185 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:34.185 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:34.185 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:34.185 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.194 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.195 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:34.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:34.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:34.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:34.290 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:34.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:34.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:34.292 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:34.293 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:34.381 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:34.381 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:34.381 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:34.382 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:34.382 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:34.390 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:34.390 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:34.390 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:34.390 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.391 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:34.391 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.391 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:34.486 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:34.487 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:34.487 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:34.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:34.489 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:34.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:34.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:34.492 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:34.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:34.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:34.578 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:34.578 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:34.578 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:34.578 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:34.578 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:34.587 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:34.587 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:34.588 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:34.588 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:34.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:34.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:34.588 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:34.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:34.589 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:34.589 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:34.682 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:34.682 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:34.683 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:34.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:34.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 0 = 0 ']' 2020-02-08T18:27:34.684 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: expr 2 + 1 2020-02-08T18:27:34.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: zerocount=3 2020-02-08T18:27:34.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 3 -gt 3 ']' 2020-02-08T18:27:34.686 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: expr 713 + 0 2020-02-08T18:27:34.687 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:139: TEST_recover_unexpected: total=713 2020-02-08T18:27:34.688 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: expr 2 '*' 2 2020-02-08T18:27:34.688 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:140: TEST_recover_unexpected: sleep 4 2020-02-08T18:27:38.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:120: TEST_recover_unexpected: true 2020-02-08T18:27:38.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:122: TEST_recover_unexpected: pass=0 2020-02-08T18:27:38.691 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: expr 6 - 1 2020-02-08T18:27:38.693 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:38.694 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:38.702 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:38.702 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:38.702 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:38.703 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:38.703 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:38.703 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:38.703 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:38.703 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:38.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:38.793 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:38.793 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:38.793 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:38.793 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:38.793 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:38.804 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:38.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.0 2020-02-08T18:27:38.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2020-02-08T18:27:38.804 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2020-02-08T18:27:38.804 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:38.804 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:38.805 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:38.805 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.0.asok 2020-02-08T18:27:38.805 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:38.805 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.0.asok dump_scrub_reservations 2020-02-08T18:27:38.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:38.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:38.899 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:38.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:38.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:38.901 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:38.901 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:38.901 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:38.902 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:38.903 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:38.903 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:38.903 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:38.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:38.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:38.989 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:38.989 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:38.989 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:38.989 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:38.990 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:38.998 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.1 2020-02-08T18:27:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2020-02-08T18:27:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2020-02-08T18:27:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:38.998 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:38.999 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:38.999 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.1.asok 2020-02-08T18:27:38.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.000 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.1.asok dump_scrub_reservations 2020-02-08T18:27:39.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:39.094 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:39.095 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:39.095 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:39.095 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:39.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:39.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:39.097 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:39.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.097 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.098 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:39.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.098 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:39.185 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:39.185 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:39.185 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:39.185 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:39.186 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:39.194 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:39.194 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.2 2020-02-08T18:27:39.194 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2020-02-08T18:27:39.194 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2020-02-08T18:27:39.195 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.195 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.195 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.195 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.2.asok 2020-02-08T18:27:39.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.195 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.2.asok dump_scrub_reservations 2020-02-08T18:27:39.290 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:39.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:39.291 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:39.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:39.292 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:39.293 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:39.293 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:39.294 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:39.294 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.294 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.294 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.294 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:39.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.295 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:39.382 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:39.382 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:39.382 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:39.382 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:39.382 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:39.390 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.3 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.3 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.3 ']' 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.391 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.3.asok 2020-02-08T18:27:39.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.3.asok dump_scrub_reservations 2020-02-08T18:27:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:39.488 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:39.489 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:39.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:39.490 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:39.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:39.491 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:39.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.492 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:39.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:39.586 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:39.586 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:39.586 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:39.586 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:39.586 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:39.589 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.4 2020-02-08T18:27:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.4 2020-02-08T18:27:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.4 ']' 2020-02-08T18:27:39.589 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.590 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.4.asok 2020-02-08T18:27:39.590 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.590 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.4.asok dump_scrub_reservations 2020-02-08T18:27:39.684 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:39.685 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:39.685 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:39.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:39.686 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:123: TEST_recover_unexpected: for o in $(seq 0 $(expr $OSDS - 1)) 2020-02-08T18:27:39.687 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:39.687 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:39.687 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:39.688 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.688 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.688 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.688 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:39.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:39.775 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:27:39.775 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_local": 0, 2020-02-08T18:27:39.775 INFO:tasks.workunit.client.0.smithi157.stdout: "scrubs_remote": 0, 2020-02-08T18:27:39.775 INFO:tasks.workunit.client.0.smithi157.stdout: "osd_max_scrubs": 4 2020-02-08T18:27:39.775 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:27:39.799 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: jq '.scrubs_local + .scrubs_remote' 2020-02-08T18:27:39.799 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: get_asok_path osd.5 2020-02-08T18:27:39.799 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.5 2020-02-08T18:27:39.799 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.5 ']' 2020-02-08T18:27:39.799 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:39.800 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:39.800 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:39.800 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.29983/ceph-osd.5.asok 2020-02-08T18:27:39.800 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: CEPH_ARGS= 2020-02-08T18:27:39.800 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: ceph daemon /tmp/ceph-asok.29983/ceph-osd.5.asok dump_scrub_reservations 2020-02-08T18:27:39.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: TEST_recover_unexpected: scrubs=0 2020-02-08T18:27:39.880 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: TEST_recover_unexpected: '[' 0 -gt 4 ']' 2020-02-08T18:27:39.880 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: expr 0 + 0 2020-02-08T18:27:39.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:131: TEST_recover_unexpected: pass=0 2020-02-08T18:27:39.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:133: TEST_recover_unexpected: '[' 0 = 0 ']' 2020-02-08T18:27:39.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: expr 3 + 1 2020-02-08T18:27:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:134: TEST_recover_unexpected: zerocount=4 2020-02-08T18:27:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:136: TEST_recover_unexpected: '[' 4 -gt 3 ']' 2020-02-08T18:27:39.883 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:137: TEST_recover_unexpected: break 2020-02-08T18:27:39.883 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: seq 0 5 2020-02-08T18:27:39.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: for i in $(seq 0 5) 2020-02-08T18:27:39.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:27:39.884 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:27:40.118 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:27:40.126 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: TEST_recover_unexpected: sleep 2 2020-02-08T18:27:42.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: for i in $(seq 0 5) 2020-02-08T18:27:42.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:27:42.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:27:42.373 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:27:42.381 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: TEST_recover_unexpected: sleep 2 2020-02-08T18:27:44.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: for i in $(seq 0 5) 2020-02-08T18:27:44.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:27:44.383 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:27:44.631 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:27:44.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: TEST_recover_unexpected: sleep 2 2020-02-08T18:27:46.640 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: for i in $(seq 0 5) 2020-02-08T18:27:46.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:27:46.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:27:46.886 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:27:46.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: TEST_recover_unexpected: sleep 2 2020-02-08T18:27:48.895 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: for i in $(seq 0 5) 2020-02-08T18:27:48.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:27:48.896 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:27:49.141 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:27:49.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: TEST_recover_unexpected: sleep 2 2020-02-08T18:27:51.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: TEST_recover_unexpected: for i in $(seq 0 5) 2020-02-08T18:27:51.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: ceph pg dump pgs 2020-02-08T18:27:51.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: TEST_recover_unexpected: grep scrubbing 2020-02-08T18:27:51.396 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:27:51.404 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: TEST_recover_unexpected: sleep 2 2020-02-08T18:27:53.405 INFO:tasks.workunit.client.0.smithi157.stdout:713 total reservations seen 2020-02-08T18:27:53.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:153: TEST_recover_unexpected: echo 713 total reservations seen 2020-02-08T18:27:53.406 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: TEST_recover_unexpected: expr 16 '*' 3 '*' 3 2020-02-08T18:27:53.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: TEST_recover_unexpected: actual_reservations=144 2020-02-08T18:27:53.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: TEST_recover_unexpected: '[' 713 -lt 144 ']' 2020-02-08T18:27:53.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:164: TEST_recover_unexpected: return 0 2020-02-08T18:27:53.408 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:45: run: teardown td/osd-scrub-dump 2020-02-08T18:27:53.408 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-dump 2020-02-08T18:27:53.408 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:27:53.408 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-dump KILL 2020-02-08T18:27:53.409 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:27:53.409 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:27:53.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:27:53.409 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:27:53.410 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:27:53.521 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:27:53.521 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:27:53.522 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:27:53.522 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:27:53.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:27:53.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:27:53.524 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:27:53.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:27:53.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:27:53.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:27:53.535 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:27:53.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:27:53.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:27:53.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-dump 2020-02-08T18:27:53.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:27:53.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:53.648 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:53.648 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.29983 2020-02-08T18:27:53.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:27:53.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:27:53.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: code=0 2020-02-08T18:27:53.651 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: teardown td/osd-scrub-dump 0 2020-02-08T18:27:53.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-dump 2020-02-08T18:27:53.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2020-02-08T18:27:53.652 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-dump KILL 2020-02-08T18:27:53.652 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:27:53.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:27:53.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:27:53.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:27:53.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:27:53.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:27:53.654 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:27:53.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:27:53.656 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:27:53.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:27:53.656 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:27:53.656 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:27:53.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:27:53.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:27:53.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:27:53.657 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:27:53.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:27:53.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2020-02-08T18:27:53.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-dump 2020-02-08T18:27:53.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:27:53.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:53.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.29983 2020-02-08T18:27:53.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.29983 2020-02-08T18:27:53.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:27:53.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:27:53.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: return 0 2020-02-08T18:27:53.662 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-02-08T18:27:53.662 INFO:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-02-08T18:27:53.701 INFO:tasks.workunit:Running workunit scrub/osd-scrub-repair.sh... 2020-02-08T18:27:53.702 INFO:teuthology.orchestra.run.smithi157:workunit test scrub/osd-scrub-repair.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f366546002698478e7b1888bb3d9023bb85c3032 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh 2020-02-08T18:27:53.758 INFO:tasks.workunit.client.0.smithi157.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2020-02-08T18:27:53.758 INFO:tasks.workunit.client.0.smithi157.stderr:++ TIMEOUT=300 2020-02-08T18:27:53.758 INFO:tasks.workunit.client.0.smithi157.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2020-02-08T18:27:53.758 INFO:tasks.workunit.client.0.smithi157.stderr:++ MAX_TIMEOUT=15 2020-02-08T18:27:53.758 INFO:tasks.workunit.client.0.smithi157.stderr:++ PG_NUM=4 2020-02-08T18:27:53.758 INFO:tasks.workunit.client.0.smithi157.stderr:++ TMPDIR=/tmp 2020-02-08T18:27:53.759 INFO:tasks.workunit.client.0.smithi157.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2020-02-08T18:27:53.759 INFO:tasks.workunit.client.0.smithi157.stderr:++ TESTDIR=/home/ubuntu/cephtest 2020-02-08T18:27:53.759 INFO:tasks.workunit.client.0.smithi157.stderr:++ type xmlstarlet 2020-02-08T18:27:53.759 INFO:tasks.workunit.client.0.smithi157.stderr:++ XMLSTARLET=xmlstarlet 2020-02-08T18:27:53.759 INFO:tasks.workunit.client.0.smithi157.stderr:+++ uname 2020-02-08T18:27:53.759 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' Linux = FreeBSD ']' 2020-02-08T18:27:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:++ SED=sed 2020-02-08T18:27:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:++ AWK=awk 2020-02-08T18:27:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:+++ stty -a 2020-02-08T18:27:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:+++ head -1 2020-02-08T18:27:53.760 INFO:tasks.workunit.client.0.smithi157.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2020-02-08T18:27:53.761 INFO:tasks.workunit.client.0.smithi157.stderr:stty: 'standard input': Inappropriate ioctl for device 2020-02-08T18:27:53.761 INFO:tasks.workunit.client.0.smithi157.stderr:++ termwidth= 2020-02-08T18:27:53.761 INFO:tasks.workunit.client.0.smithi157.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2020-02-08T18:27:53.762 INFO:tasks.workunit.client.0.smithi157.stderr:++ DIFFCOLOPTS='-y ' 2020-02-08T18:27:53.762 INFO:tasks.workunit.client.0.smithi157.stderr:++ KERNCORE=kernel.core_pattern 2020-02-08T18:27:53.762 INFO:tasks.workunit.client.0.smithi157.stderr:++ EXTRA_OPTS= 2020-02-08T18:27:53.764 INFO:tasks.workunit.client.0.smithi157.stderr:++ test '' = TESTS 2020-02-08T18:27:53.764 INFO:tasks.workunit.client.0.smithi157.stderr:++ uname 2020-02-08T18:27:53.765 INFO:tasks.workunit.client.0.smithi157.stderr:+ '[' Linux = FreeBSD ']' 2020-02-08T18:27:53.765 INFO:tasks.workunit.client.0.smithi157.stderr:+ use_ec_overwrite=true 2020-02-08T18:27:53.765 INFO:tasks.workunit.client.0.smithi157.stderr:+ getjson=no 2020-02-08T18:27:53.765 INFO:tasks.workunit.client.0.smithi157.stderr:+ jqfilter='def walk(f): 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: . as $in 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: | if type == "object" then 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: reduce keys[] as $key 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: elif type == "array" then map( walk(f) ) | f 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: else f 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr: end; 2020-02-08T18:27:53.766 INFO:tasks.workunit.client.0.smithi157.stderr:walk(if type == "object" then del(.mtime) else . end) 2020-02-08T18:27:53.767 INFO:tasks.workunit.client.0.smithi157.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2020-02-08T18:27:53.767 INFO:tasks.workunit.client.0.smithi157.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2020-02-08T18:27:53.767 INFO:tasks.workunit.client.0.smithi157.stderr:| walk(if type == "object" then del(.version) else . end) 2020-02-08T18:27:53.767 INFO:tasks.workunit.client.0.smithi157.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2020-02-08T18:27:53.767 INFO:tasks.workunit.client.0.smithi157.stderr:+ sortkeys='import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print json.dumps(ud, sort_keys=True, indent=2)' 2020-02-08T18:27:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:+ main osd-scrub-repair 2020-02-08T18:27:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:+ local dir=td/osd-scrub-repair 2020-02-08T18:27:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:+ shift 2020-02-08T18:27:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:+ shopt -s -o xtrace 2020-02-08T18:27:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2020-02-08T18:27:53.773 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-02-08T18:27:53.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2138: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2020-02-08T18:27:53.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: main: export PYTHONWARNINGS=ignore 2020-02-08T18:27:53.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2139: main: PYTHONWARNINGS=ignore 2020-02-08T18:27:53.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: main: export CEPH_CONF=/dev/null 2020-02-08T18:27:53.774 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2140: main: CEPH_CONF=/dev/null 2020-02-08T18:27:53.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2141: main: unset CEPH_ARGS 2020-02-08T18:27:53.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2143: main: local code 2020-02-08T18:27:53.775 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: run td/osd-scrub-repair 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:51: run: local dir=td/osd-scrub-repair 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:52: run: shift 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:54: run: export CEPH_MON=127.0.0.1:7107 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:54: run: CEPH_MON=127.0.0.1:7107 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:55: run: export CEPH_ARGS 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:56: run: uuidgen 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:56: run: CEPH_ARGS+='--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none ' 2020-02-08T18:27:53.776 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:57: run: CEPH_ARGS+='--mon-host=127.0.0.1:7107 ' 2020-02-08T18:27:53.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:58: run: CEPH_ARGS+='--osd-skip-data-digest=false ' 2020-02-08T18:27:53.777 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:60: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2020-02-08T18:27:53.777 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:61: run: set 2020-02-08T18:27:53.777 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:61: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2020-02-08T18:27:53.780 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:61: run: local 'funcs=TEST_allow_repair_during_recovery 2020-02-08T18:27:53.780 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_auto_repair_bluestore_basic 2020-02-08T18:27:53.780 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_auto_repair_bluestore_failed 2020-02-08T18:27:53.780 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_auto_repair_bluestore_failed_norecov 2020-02-08T18:27:53.780 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_auto_repair_bluestore_scrub 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_auto_repair_erasure_coded_appends 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_auto_repair_erasure_coded_overwrites 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_and_repair_jerasure_appends 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_and_repair_jerasure_overwrites 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_and_repair_lrc_appends 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_and_repair_lrc_overwrites 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_and_repair_replicated 2020-02-08T18:27:53.781 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_scrub_erasure_appends 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_scrub_erasure_overwrites 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_scrub_replicated 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_corrupt_snapset_scrub_rep 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_list_missing_erasure_coded_appends 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_list_missing_erasure_coded_overwrites 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_periodic_scrub_replicated 2020-02-08T18:27:53.782 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_repair_stats 2020-02-08T18:27:53.783 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_repair_stats_ec 2020-02-08T18:27:53.783 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_request_scrub_priority 2020-02-08T18:27:53.783 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_scrub_warning 2020-02-08T18:27:53.783 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_skip_non_repair_during_recovery 2020-02-08T18:27:53.783 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_unfound_erasure_coded_appends 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:TEST_unfound_erasure_coded_overwrites' 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: for func in $funcs 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: TEST_allow_repair_during_recovery td/osd-scrub-repair 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:114: TEST_allow_repair_during_recovery: local dir=td/osd-scrub-repair 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:115: TEST_allow_repair_during_recovery: local poolname=rbd 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:117: TEST_allow_repair_during_recovery: setup td/osd-scrub-repair 2020-02-08T18:27:53.784 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-scrub-repair 2020-02-08T18:27:53.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-scrub-repair 2020-02-08T18:27:53.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-repair 2020-02-08T18:27:53.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:27:53.785 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-repair KILL 2020-02-08T18:27:53.785 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:27:53.786 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:27:53.787 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:27:53.787 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:27:53.790 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:27:53.791 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:27:53.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-repair 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.105831 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:27:53.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-scrub-repair 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.105831 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2020-02-08T18:27:53.797 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:118: TEST_allow_repair_during_recovery: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-scrub-repair 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-02-08T18:27:53.798 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-scrub-repair/a 2020-02-08T18:27:53.799 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2020-02-08T18:27:54.004 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-02-08T18:27:54.004 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:27:54.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:27:54.005 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:27:54.005 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:54.005 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:54.006 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:27:54.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --osd_pool_default_size=2 2020-02-08T18:27:54.177 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: cat 2020-02-08T18:27:54.178 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a fsid 2020-02-08T18:27:54.178 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=fsid 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .fsid 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:27:54.179 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:54.180 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:54.180 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:54.180 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.105831/ceph-mon.a.asok 2020-02-08T18:27:54.180 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:27:54.180 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.105831/ceph-mon.a.asok config get fsid 2020-02-08T18:27:54.264 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a mon_host 2020-02-08T18:27:54.264 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:27:54.264 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:27:54.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=mon_host 2020-02-08T18:27:54.265 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .mon_host 2020-02-08T18:27:54.265 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:27:54.265 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:27:54.265 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:27:54.266 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:27:54.266 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:54.266 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:54.266 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.105831/ceph-mon.a.asok 2020-02-08T18:27:54.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:27:54.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.105831/ceph-mon.a.asok config get mon_host 2020-02-08T18:27:54.350 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:119: TEST_allow_repair_during_recovery: run_mgr td/osd-scrub-repair x 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:551: run_mgr: local dir=td/osd-scrub-repair 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: shift 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local id=x 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local data=td/osd-scrub-repair/x 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: get_asok_path 2020-02-08T18:27:54.351 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:27:54.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:27:54.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:27:54.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:54.352 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:54.352 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:27:54.353 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:27:54.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:27:54.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:120: TEST_allow_repair_during_recovery: run_osd td/osd-scrub-repair 0 --osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true 2020-02-08T18:27:54.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-repair 2020-02-08T18:27:54.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:27:54.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=0 2020-02-08T18:27:54.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:27:54.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:27:54.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:27:54.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:27:54.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:27:54.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:27:54.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:27:54.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:27:54.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:27:54.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:27:54.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:27:54.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:27:54.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:27:54.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:27:54.984 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:27:54.985 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:27:54.985 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:27:54.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:27:54.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:27:54.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:27:54.985 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:27:54.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:27:54.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:27:54.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:27:54.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:27:54.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:27:54.986 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:27:54.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:27:54.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+='--osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true' 2020-02-08T18:27:54.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:27:54.987 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:27:54.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=4d6802f1-bf46-4587-aade-973992eb724e 2020-02-08T18:27:54.987 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd0 4d6802f1-bf46-4587-aade-973992eb724e' 2020-02-08T18:27:54.988 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:27:54.988 INFO:tasks.workunit.client.0.smithi157.stdout:add osd0 4d6802f1-bf46-4587-aade-973992eb724e 2020-02-08T18:27:55.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCq/T5eZwmAOxAA99O3XZUhIG1+GirKfrgI7A== 2020-02-08T18:27:55.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCq/T5eZwmAOxAA99O3XZUhIG1+GirKfrgI7A=="}' 2020-02-08T18:27:55.001 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 4d6802f1-bf46-4587-aade-973992eb724e -i td/osd-scrub-repair/0/new.json 2020-02-08T18:27:55.259 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:27:55.269 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-repair/0/new.json 2020-02-08T18:27:55.270 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true --mkfs --key AQCq/T5eZwmAOxAA99O3XZUhIG1+GirKfrgI7A== --osd-uuid 4d6802f1-bf46-4587-aade-973992eb724e 2020-02-08T18:27:55.294 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.292+0000 7fa3e9d30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:27:55.296 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.295+0000 7fa3e9d30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:27:55.298 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.296+0000 7fa3e9d30ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:27:55.299 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.297+0000 7fa3e9d30ec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:27:55.299 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.297+0000 7fa3e9d30ec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:27:55.299 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.297+0000 7fa3e9d30ec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:27:55.342 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:55.341+0000 7fa3e9d30ec0 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2020-02-08T18:27:58.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2020-02-08T18:27:58.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:27:58.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd0 key to auth repository 2020-02-08T18:27:58.347 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:27:58.348 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd0 key to auth repository 2020-02-08T18:27:58.550 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.0 2020-02-08T18:27:58.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.0 2020-02-08T18:27:58.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:27:58.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true 2020-02-08T18:27:58.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:27:58.550 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:27:58.572 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:58.570+0000 7f42b9e73ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:27:58.574 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:58.572+0000 7f42b9e73ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:27:58.576 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:58.574+0000 7f42b9e73ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:27:58.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 0 2020-02-08T18:27:58.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:27:58.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:27:58.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:27:58.795 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:27:58.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:27:58.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:27:58.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:27:58.796 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:27:58.796 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:27:59.033 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:27:59.091 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:59.089+0000 7f42b9e73ec0 -1 Falling back to public interface 2020-02-08T18:27:59.874 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:27:59.872+0000 7f42b9e73ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-08T18:28:00.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:00.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:00.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:28:00.034 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:00.035 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:00.035 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:28:00.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:01.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:01.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:01.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:28:01.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:01.285 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:01.285 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:28:01.529 INFO:tasks.workunit.client.0.smithi157.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/106221,v1:127.0.0.1:6803/106221] [v2:127.0.0.1:6804/106221,v1:127.0.0.1:6805/106221] exists,up 4d6802f1-bf46-4587-aade-973992eb724e 2020-02-08T18:28:01.529 INFO:tasks.workunit.client.0.smithi157.stdout:add osd1 256f66f7-0c21-492c-944f-5b106f0eecc6 2020-02-08T18:28:01.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:28:01.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:28:01.529 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:123: TEST_allow_repair_during_recovery: run_osd td/osd-scrub-repair 1 --osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-repair 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=1 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-repair/1 2020-02-08T18:28:01.530 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:28:01.531 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:01.532 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:28:01.533 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:28:01.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:28:01.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:01.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:28:01.534 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+='--osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true' 2020-02-08T18:28:01.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-repair/1 2020-02-08T18:28:01.535 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:28:01.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=256f66f7-0c21-492c-944f-5b106f0eecc6 2020-02-08T18:28:01.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd1 256f66f7-0c21-492c-944f-5b106f0eecc6' 2020-02-08T18:28:01.535 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:28:01.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQCx/T5eThI0IBAAqf+qp3h2NJi6DhtALKGfCQ== 2020-02-08T18:28:01.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQCx/T5eThI0IBAAqf+qp3h2NJi6DhtALKGfCQ=="}' 2020-02-08T18:28:01.542 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 256f66f7-0c21-492c-944f-5b106f0eecc6 -i td/osd-scrub-repair/1/new.json 2020-02-08T18:28:01.849 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:28:01.859 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-repair/1/new.json 2020-02-08T18:28:01.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 1 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true --mkfs --key AQCx/T5eThI0IBAAqf+qp3h2NJi6DhtALKGfCQ== --osd-uuid 256f66f7-0c21-492c-944f-5b106f0eecc6 2020-02-08T18:28:01.884 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.882+0000 7ffb534e4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:01.886 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.884+0000 7ffb534e4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:01.888 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.885+0000 7ffb534e4ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:01.888 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.886+0000 7ffb534e4ec0 -1 bluestore(td/osd-scrub-repair/1/block) _read_bdev_label failed to open td/osd-scrub-repair/1/block: (2) No such file or directory 2020-02-08T18:28:01.889 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.886+0000 7ffb534e4ec0 -1 bluestore(td/osd-scrub-repair/1/block) _read_bdev_label failed to open td/osd-scrub-repair/1/block: (2) No such file or directory 2020-02-08T18:28:01.889 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.886+0000 7ffb534e4ec0 -1 bluestore(td/osd-scrub-repair/1/block) _read_bdev_label failed to open td/osd-scrub-repair/1/block: (2) No such file or directory 2020-02-08T18:28:01.973 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:01.971+0000 7ffb534e4ec0 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2020-02-08T18:28:05.131 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2020-02-08T18:28:05.132 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:28:05.133 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd1 key to auth repository 2020-02-08T18:28:05.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd1 key to auth repository 2020-02-08T18:28:05.133 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:28:05.430 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.1 2020-02-08T18:28:05.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.1 2020-02-08T18:28:05.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 1 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd_scrub_during_recovery=false --osd_repair_during_recovery=true --osd_debug_pretend_recovery_active=true 2020-02-08T18:28:05.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:28:05.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:28:05.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:28:05.452 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:05.450+0000 7f79e8403ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:05.458 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:05.452+0000 7f79e8403ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:05.458 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:05.454+0000 7f79e8403ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 1 2020-02-08T18:28:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:28:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=1 2020-02-08T18:28:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:28:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:28:05.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:05.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:28:05.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:05.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:28:05.674 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:28:05.911 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:05.975 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:05.973+0000 7f79e8403ec0 -1 Falling back to public interface 2020-02-08T18:28:06.737 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:06.736+0000 7f79e8403ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-08T18:28:06.912 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:06.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:06.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:28:06.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:06.913 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:28:06.913 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:28:07.157 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:08.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:08.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:08.158 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:28:08.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:08.159 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:28:08.159 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:28:08.406 INFO:tasks.workunit.client.0.smithi157.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/106598,v1:127.0.0.1:6811/106598] [v2:127.0.0.1:6812/106598,v1:127.0.0.1:6813/106598] exists,up 256f66f7-0c21-492c-944f-5b106f0eecc6 2020-02-08T18:28:08.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:28:08.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:28:08.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:28:08.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:126: TEST_allow_repair_during_recovery: create_rbd_pool 2020-02-08T18:28:08.407 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2020-02-08T18:28:08.646 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'rbd' does not exist 2020-02-08T18:28:08.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: create_pool rbd 4 2020-02-08T18:28:08.654 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:539: create_pool: ceph osd pool create rbd 4 2020-02-08T18:28:09.022 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'rbd' created 2020-02-08T18:28:09.030 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: sleep 1 2020-02-08T18:28:10.032 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: rbd pool init rbd 2020-02-08T18:28:10.803 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:127: TEST_allow_repair_during_recovery: wait_for_clean 2020-02-08T18:28:10.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:28:10.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:28:10.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:28:10.804 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:28:10.805 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:28:10.805 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:28:10.805 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:28:10.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:28:10.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:28:10.806 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:28:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:28:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:28:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:28:10.907 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:28:10.907 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:28:11.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:28:11.145 INFO:tasks.workunit.client.0.smithi157.stderr:1' 2020-02-08T18:28:11.145 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:28:11.146 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:28:11.146 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:28:11.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=21474836485 2020-02-08T18:28:11.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836485' 2020-02-08T18:28:11.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:28:11.257 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:28:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672962 2020-02-08T18:28:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836485 1-42949672962' 2020-02-08T18:28:11.367 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:28:11.368 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-21474836485 2020-02-08T18:28:11.368 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:28:11.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:28:11.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-21474836485 2020-02-08T18:28:11.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:28:11.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=21474836485 2020-02-08T18:28:11.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2020-02-08T18:28:11.371 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.0 seq 21474836485 2020-02-08T18:28:11.372 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:28:11.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836483 -lt 21474836485 2020-02-08T18:28:11.609 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:28:12.610 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:28:12.611 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:28:12.860 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836485 -lt 21474836485 2020-02-08T18:28:12.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:28:12.861 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672962 2020-02-08T18:28:12.862 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:28:12.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:28:12.863 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672962 2020-02-08T18:28:12.864 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:28:12.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672962 2020-02-08T18:28:12.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2020-02-08T18:28:12.865 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.1 seq 42949672962 2020-02-08T18:28:12.865 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:28:13.105 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672962 -lt 42949672962 2020-02-08T18:28:13.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:28:13.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:28:13.106 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:28:13.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 4 == 0 2020-02-08T18:28:13.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:28:13.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:28:13.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:28:13.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:28:13.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:28:13.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:28:13.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:28:13.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=4 2020-02-08T18:28:13.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:28:13.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:28:13.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:28:13.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 4 = 4 2020-02-08T18:28:13.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:28:13.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:28:13.920 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:129: TEST_allow_repair_during_recovery: add_something td/osd-scrub-repair rbd 2020-02-08T18:28:13.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:68: add_something: local dir=td/osd-scrub-repair 2020-02-08T18:28:13.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:69: add_something: local poolname=rbd 2020-02-08T18:28:13.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:70: add_something: local obj=SOMETHING 2020-02-08T18:28:13.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local scrub=noscrub 2020-02-08T18:28:13.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: '[' noscrub = noscrub ']' 2020-02-08T18:28:13.921 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:75: add_something: ceph osd set noscrub 2020-02-08T18:28:14.291 INFO:tasks.workunit.client.0.smithi157.stderr:noscrub is set 2020-02-08T18:28:14.293 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: ceph osd set nodeep-scrub 2020-02-08T18:28:14.688 INFO:tasks.workunit.client.0.smithi157.stderr:nodeep-scrub is set 2020-02-08T18:28:14.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:82: add_something: local payload=ABCDEF 2020-02-08T18:28:14.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:83: add_something: echo ABCDEF 2020-02-08T18:28:14.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:84: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2020-02-08T18:28:14.814 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:130: TEST_allow_repair_during_recovery: get_not_primary rbd SOMETHING 2020-02-08T18:28:14.814 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1165: get_not_primary: local poolname=rbd 2020-02-08T18:28:14.814 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1166: get_not_primary: local objectname=SOMETHING 2020-02-08T18:28:14.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: get_primary rbd SOMETHING 2020-02-08T18:28:14.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_primary: local poolname=rbd 2020-02-08T18:28:14.814 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1133: get_primary: local objectname=SOMETHING 2020-02-08T18:28:14.815 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: ceph --format json osd map rbd SOMETHING 2020-02-08T18:28:14.815 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: get_primary: jq .acting_primary 2020-02-08T18:28:15.056 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local primary=1 2020-02-08T18:28:15.056 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1169: get_not_primary: ceph --format json osd map rbd SOMETHING 2020-02-08T18:28:15.057 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-02-08T18:28:15.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:130: TEST_allow_repair_during_recovery: corrupt_and_repair_one td/osd-scrub-repair rbd 0 2020-02-08T18:28:15.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:232: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2020-02-08T18:28:15.332 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: corrupt_and_repair_one: local poolname=rbd 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:234: corrupt_and_repair_one: local osd=0 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:239: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: objectstore_tool: local dir=td/osd-scrub-repair 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: objectstore_tool: shift 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local id=0 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2020-02-08T18:28:15.333 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1205: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1206: _objectstore_tool_nowait: shift 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local id=0 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:28:15.334 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:28:15.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:28:15.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:28:15.335 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1193: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1194: _objectstore_tool_nodown: shift 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local id=0 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-02-08T18:28:15.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:28:15.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2020-02-08T18:28:16.072 INFO:tasks.workunit.client.0.smithi157.stdout:remove #1:eb822e21:::SOMETHING:head# 2020-02-08T18:28:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2020-02-08T18:28:16.590 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:842: activate_osd: local dir=td/osd-scrub-repair 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: shift 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local id=0 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:28:16.591 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --chdir=' 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+= 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: get_asok_path 2020-02-08T18:28:16.592 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:16.593 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' ' 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+= 2020-02-08T18:28:16.594 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:28:16.595 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: echo start osd.0 2020-02-08T18:28:16.595 INFO:tasks.workunit.client.0.smithi157.stderr:start osd.0 2020-02-08T18:28:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:16.596 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: cat td/osd-scrub-repair/0/whoami 2020-02-08T18:28:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: '[' 0 = 0 ']' 2020-02-08T18:28:16.596 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph osd dump --format=json 2020-02-08T18:28:16.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: jq '.flags_set[]' 2020-02-08T18:28:16.597 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: grep -q '"noup"' 2020-02-08T18:28:16.612 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:16.610+0000 7f4021dd0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:16.614 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:16.612+0000 7f4021dd0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:16.616 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:16.614+0000 7f4021dd0ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:16.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: wait_for_osd up 0 2020-02-08T18:28:16.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:28:16.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:28:16.838 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:28:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:28:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:28:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:0 2020-02-08T18:28:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:16.839 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:17.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:17.135 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:17.134+0000 7f4021dd0ec0 -1 Falling back to public interface 2020-02-08T18:28:17.930 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:17.929+0000 7f4021dd0ec0 -1 osd.0 22 log_to_monitors {default=true} 2020-02-08T18:28:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:28:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:28:18.078 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:18.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:osd.0 up in weight 1 up_from 25 up_thru 12 down_at 23 last_clean_interval [5,22) [v2:127.0.0.1:6802/107438,v1:127.0.0.1:6803/107438] [v2:127.0.0.1:6804/107438,v1:127.0.0.1:6805/107438] exists,up 4d6802f1-bf46-4587-aade-973992eb724e 2020-02-08T18:28:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:28:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:28:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:28:18.345 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: objectstore_tool: wait_for_clean 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:28:18.346 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:28:18.347 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:28:18.347 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:28:18.347 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:28:18.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:28:18.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:28:18.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:28:18.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:28:18.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:28:18.705 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:28:18.705 INFO:tasks.workunit.client.0.smithi157.stderr:1' 2020-02-08T18:28:18.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:28:18.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:28:18.706 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:28:18.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=107374182402 2020-02-08T18:28:18.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-107374182402' 2020-02-08T18:28:18.815 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:28:18.816 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:28:18.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672965 2020-02-08T18:28:18.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-107374182402 1-42949672965' 2020-02-08T18:28:18.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:28:18.927 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-107374182402 2020-02-08T18:28:18.927 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:28:18.928 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:28:18.928 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-107374182402 2020-02-08T18:28:18.928 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:28:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=107374182402 2020-02-08T18:28:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 107374182402' 2020-02-08T18:28:18.929 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.0 seq 107374182402 2020-02-08T18:28:18.929 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:28:19.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 1 -lt 107374182402 2020-02-08T18:28:19.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:28:20.169 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:28:20.170 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:28:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 1 -lt 107374182402 2020-02-08T18:28:20.423 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:28:21.418 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 299 -eq 0 ']' 2020-02-08T18:28:21.418 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:28:21.666 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 107374182402 -lt 107374182402 2020-02-08T18:28:21.667 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:28:21.667 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672965 2020-02-08T18:28:21.668 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:28:21.668 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:28:21.668 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672965 2020-02-08T18:28:21.669 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:28:21.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672965 2020-02-08T18:28:21.669 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2020-02-08T18:28:21.669 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.1 seq 42949672965 2020-02-08T18:28:21.670 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:28:21.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672965 -lt 42949672965 2020-02-08T18:28:21.908 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:28:21.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:28:21.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:28:22.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 4 == 0 2020-02-08T18:28:22.197 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:28:22.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:28:22.197 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:28:22.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:28:22.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:28:22.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:28:22.198 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:28:22.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=4 2020-02-08T18:28:22.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:28:22.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:28:22.432 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:28:22.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 4 = 4 2020-02-08T18:28:22.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:28:22.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:28:22.724 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:243: corrupt_and_repair_one: get_pg rbd SOMETHING 2020-02-08T18:28:22.725 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1029: get_pg: local poolname=rbd 2020-02-08T18:28:22.725 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1030: get_pg: local objectname=SOMETHING 2020-02-08T18:28:22.725 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: ceph --format json osd map rbd SOMETHING 2020-02-08T18:28:22.725 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: jq -r .pgid 2020-02-08T18:28:22.967 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:243: corrupt_and_repair_one: local pg=1.3 2020-02-08T18:28:22.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:244: corrupt_and_repair_one: repair 1.3 2020-02-08T18:28:22.968 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1752: repair: local pgid=1.3 2020-02-08T18:28:22.968 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1753: repair: get_last_scrub_stamp 1.3 2020-02-08T18:28:22.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:22.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:22.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:22.969 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:23.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1753: repair: local last_scrub=2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:23.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1754: repair: ceph pg repair 1.3 2020-02-08T18:28:23.427 INFO:tasks.workunit.client.0.smithi157.stderr:instructing pg 1.3 on osd.1 to repair 2020-02-08T18:28:23.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: repair: wait_for_scrub 1.3 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:23.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.3 2020-02-08T18:28:23.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:23.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:28:23.436 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:28:23.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:23.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:23.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:23.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:23.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:23.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:23.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:23.681 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:24.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:24.671 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:24.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:24.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:24.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:24.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:24.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:24.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:24.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:25.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:25.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:25.919 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:25.919 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:25.919 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:25.919 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:25.920 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:26.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:26.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:27.167 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:27.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:27.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:27.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:27.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:27.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:27.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:27.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:27.411 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:28.413 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:28.413 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:28.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:28.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:28.413 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:28.414 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:28.414 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:28.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:28.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:29.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:29.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:29.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:29.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:29.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:29.661 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:29.661 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:29.903 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:29.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:30.904 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:30.905 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:30.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:30.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:30.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:30.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:30.906 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:31.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:31.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:32.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:32.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:32.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:32.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:32.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:32.152 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:32.153 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:32.394 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:32.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:33.395 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:33.396 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:33.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:33.396 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:33.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:33.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:33.397 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:33.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:08.946091+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:33.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:28:34.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:28:34.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:28:34.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2020-02-08T18:28:34.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.3 2020-02-08T18:28:34.640 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:28:34.640 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:28:34.640 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2020-02-08T18:28:34.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:28:28.714404+0000 '>' 2020-02-08T18:28:08.946091+0000 2020-02-08T18:28:34.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:28:34.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: objectstore_tool: local dir=td/osd-scrub-repair 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: objectstore_tool: shift 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local id=1 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1205: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2020-02-08T18:28:34.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1206: _objectstore_tool_nowait: shift 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local id=1 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:28:34.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:28:34.888 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1193: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1194: _objectstore_tool_nodown: shift 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local id=1 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-02-08T18:28:34.990 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2020-02-08T18:28:34.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2020-02-08T18:28:35.555 INFO:tasks.workunit.client.0.smithi157.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2020-02-08T18:28:35.556 INFO:tasks.workunit.client.0.smithi157.stdout:_ 2020-02-08T18:28:35.556 INFO:tasks.workunit.client.0.smithi157.stdout:snapset 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:842: activate_osd: local dir=td/osd-scrub-repair 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: shift 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local id=1 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local osd_data=td/osd-scrub-repair/1 2020-02-08T18:28:36.075 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --chdir=' 2020-02-08T18:28:36.076 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+= 2020-02-08T18:28:36.077 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:28:36.077 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: get_asok_path 2020-02-08T18:28:36.077 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:36.077 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:36.077 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:36.077 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:36.078 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:36.079 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:36.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:36.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:28:36.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:28:36.079 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:28:36.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:28:36.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:28:36.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:36.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' ' 2020-02-08T18:28:36.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+= 2020-02-08T18:28:36.080 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: mkdir -p td/osd-scrub-repair/1 2020-02-08T18:28:36.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: echo start osd.1 2020-02-08T18:28:36.083 INFO:tasks.workunit.client.0.smithi157.stderr:start osd.1 2020-02-08T18:28:36.083 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph-osd -i 1 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:36.083 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: cat td/osd-scrub-repair/1/whoami 2020-02-08T18:28:36.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: '[' 1 = 1 ']' 2020-02-08T18:28:36.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph osd dump --format=json 2020-02-08T18:28:36.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: jq '.flags_set[]' 2020-02-08T18:28:36.084 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: grep -q '"noup"' 2020-02-08T18:28:36.098 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:36.095+0000 7f8d6e903ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:36.100 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:36.097+0000 7f8d6e903ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:36.101 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:36.098+0000 7f8d6e903ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:36.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: wait_for_osd up 1 2020-02-08T18:28:36.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:28:36.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=1 2020-02-08T18:28:36.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:28:36.328 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:28:36.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:36.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:28:36.329 INFO:tasks.workunit.client.0.smithi157.stderr:0 2020-02-08T18:28:36.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:36.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:28:36.567 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:36.625 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:36.622+0000 7f8d6e903ec0 -1 Falling back to public interface 2020-02-08T18:28:37.325 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:37.322+0000 7f8d6e903ec0 -1 osd.1 27 log_to_monitors {default=true} 2020-02-08T18:28:37.569 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:37.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:37.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:28:37.570 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:28:37.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:28:37.570 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:37.816 INFO:tasks.workunit.client.0.smithi157.stderr:osd.1 up in weight 1 up_from 30 up_thru 30 down_at 28 last_clean_interval [10,27) [v2:127.0.0.1:6810/108427,v1:127.0.0.1:6811/108427] [v2:127.0.0.1:6812/108427,v1:127.0.0.1:6813/108427] exists,up 256f66f7-0c21-492c-944f-5b106f0eecc6 2020-02-08T18:28:37.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:28:37.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:28:37.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:28:37.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: objectstore_tool: wait_for_clean 2020-02-08T18:28:37.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:28:37.817 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:28:37.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:28:37.818 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:28:37.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:28:37.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:28:37.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:28:37.908 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:28:37.909 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:28:38.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:28:38.150 INFO:tasks.workunit.client.0.smithi157.stderr:1' 2020-02-08T18:28:38.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:28:38.151 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:28:38.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:28:38.259 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=107374182407 2020-02-08T18:28:38.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-107374182407' 2020-02-08T18:28:38.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:28:38.260 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:28:38.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=128849018882 2020-02-08T18:28:38.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-107374182407 1-128849018882' 2020-02-08T18:28:38.369 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:28:38.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-107374182407 2020-02-08T18:28:38.370 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:28:38.370 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:28:38.371 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-107374182407 2020-02-08T18:28:38.371 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:28:38.371 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=107374182407 2020-02-08T18:28:38.372 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 107374182407' 2020-02-08T18:28:38.372 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.0 seq 107374182407 2020-02-08T18:28:38.372 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:28:38.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 107374182407 -lt 107374182407 2020-02-08T18:28:38.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:28:38.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-128849018882 2020-02-08T18:28:38.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:28:38.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:28:38.640 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-128849018882 2020-02-08T18:28:38.640 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:28:38.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=128849018882 2020-02-08T18:28:38.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 128849018882' 2020-02-08T18:28:38.641 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.1 seq 128849018882 2020-02-08T18:28:38.641 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:28:38.881 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 128849018882 -lt 128849018882 2020-02-08T18:28:38.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:28:38.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:28:38.882 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:28:39.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 4 == 0 2020-02-08T18:28:39.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:28:39.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:28:39.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:28:39.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:28:39.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:28:39.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:28:39.169 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:28:39.416 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=4 2020-02-08T18:28:39.416 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:28:39.416 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:28:39.416 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:28:39.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 4 = 4 2020-02-08T18:28:39.700 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:28:39.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:28:39.701 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:249: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2020-02-08T18:28:51.313 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:250: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:132: TEST_allow_repair_during_recovery: teardown td/osd-scrub-repair 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-repair 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-repair KILL 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:28:51.316 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:28:51.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:28:51.317 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:28:51.424 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:28:51.425 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:28:51.425 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:28:51.426 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:28:51.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:28:51.427 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:28:51.427 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:28:51.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:28:51.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:28:51.429 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:28:51.430 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:28:51.430 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:28:51.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:28:51.431 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-repair 2020-02-08T18:28:51.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:28:51.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:51.437 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:51.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.105831 2020-02-08T18:28:51.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:28:51.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:28:51.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: for func in $funcs 2020-02-08T18:28:51.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: TEST_auto_repair_bluestore_basic td/osd-scrub-repair 2020-02-08T18:28:51.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:333: TEST_auto_repair_bluestore_basic: local dir=td/osd-scrub-repair 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:334: TEST_auto_repair_bluestore_basic: local poolname=testpool 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:337: TEST_auto_repair_bluestore_basic: setup td/osd-scrub-repair 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-scrub-repair 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-scrub-repair 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-repair 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-repair KILL 2020-02-08T18:28:51.440 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:28:51.441 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:28:51.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:28:51.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:28:51.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:28:51.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:28:51.442 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:28:51.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:28:51.442 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:28:51.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:28:51.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:28:51.443 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:28:51.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:28:51.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:28:51.445 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:28:51.446 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:28:51.446 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:28:51.447 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:28:51.447 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-repair 2020-02-08T18:28:51.448 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:28:51.448 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:51.448 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:51.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.105831 2020-02-08T18:28:51.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:28:51.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:28:51.449 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-scrub-repair 2020-02-08T18:28:51.450 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-02-08T18:28:51.451 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:51.451 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:51.451 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.105831 2020-02-08T18:28:51.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-02-08T18:28:51.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-02-08T18:28:51.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-02-08T18:28:51.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2020-02-08T18:28:51.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:338: TEST_auto_repair_bluestore_basic: run_mon td/osd-scrub-repair a 2020-02-08T18:28:51.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-scrub-repair 2020-02-08T18:28:51.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-02-08T18:28:51.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-02-08T18:28:51.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-02-08T18:28:51.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-scrub-repair/a 2020-02-08T18:28:51.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2020-02-08T18:28:51.670 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-02-08T18:28:51.672 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:51.673 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:51.673 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:51.673 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:51.673 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:51.673 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:51.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-02-08T18:28:51.852 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: cat 2020-02-08T18:28:51.858 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a fsid 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=fsid 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .fsid 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:28:51.859 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:28:51.860 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:51.860 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:51.860 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.105831/ceph-mon.a.asok 2020-02-08T18:28:51.860 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:28:51.860 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.105831/ceph-mon.a.asok config get fsid 2020-02-08T18:28:51.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a mon_host 2020-02-08T18:28:51.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:28:51.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:28:51.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=mon_host 2020-02-08T18:28:51.943 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .mon_host 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.105831/ceph-mon.a.asok 2020-02-08T18:28:51.944 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:28:51.945 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.105831/ceph-mon.a.asok config get mon_host 2020-02-08T18:28:52.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:339: TEST_auto_repair_bluestore_basic: run_mgr td/osd-scrub-repair x 2020-02-08T18:28:52.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:551: run_mgr: local dir=td/osd-scrub-repair 2020-02-08T18:28:52.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: shift 2020-02-08T18:28:52.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local id=x 2020-02-08T18:28:52.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2020-02-08T18:28:52.029 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local data=td/osd-scrub-repair/x 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: get_asok_path 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:52.030 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:52.031 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:28:52.031 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:28:52.653 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:342: TEST_auto_repair_bluestore_basic: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:28:52.653 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: TEST_auto_repair_bluestore_basic: seq 0 2 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: TEST_auto_repair_bluestore_basic: for id in $(seq 0 2) 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: TEST_auto_repair_bluestore_basic: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-repair 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=0 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:28:52.657 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:28:52.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:52.659 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:28:52.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:28:52.661 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:28:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:28:52.662 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd0 abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb' 2020-02-08T18:28:52.662 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:28:52.662 INFO:tasks.workunit.client.0.smithi157.stdout:add osd0 abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:28:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQDk/T5eZ8/xJxAA/mQNTmgIANHHYxeDByMjlg== 2020-02-08T18:28:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQDk/T5eZ8/xJxAA/mQNTmgIANHHYxeDByMjlg=="}' 2020-02-08T18:28:52.672 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb -i td/osd-scrub-repair/0/new.json 2020-02-08T18:28:52.926 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:28:52.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-repair/0/new.json 2020-02-08T18:28:52.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDk/T5eZ8/xJxAA/mQNTmgIANHHYxeDByMjlg== --osd-uuid abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:28:52.962 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:52.960+0000 7f632389fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:52.963 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:52.962+0000 7f632389fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:52.964 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:52.963+0000 7f632389fec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:52.965 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:52.963+0000 7f632389fec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:28:52.966 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:52.963+0000 7f632389fec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:28:52.966 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:52.963+0000 7f632389fec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:28:53.018 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:53.016+0000 7f632389fec0 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2020-02-08T18:28:56.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2020-02-08T18:28:56.009 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:28:56.010 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd0 key to auth repository 2020-02-08T18:28:56.014 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd0 key to auth repository 2020-02-08T18:28:56.014 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:28:56.236 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.0 2020-02-08T18:28:56.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.0 2020-02-08T18:28:56.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:28:56.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:28:56.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:28:56.237 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:28:56.259 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:56.257+0000 7f86ec727ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:56.261 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:56.259+0000 7f86ec727ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:56.262 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:56.260+0000 7f86ec727ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:56.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 0 2020-02-08T18:28:56.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:28:56.480 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:28:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:28:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:28:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:28:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:56.481 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:56.482 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:28:56.718 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:56.777 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:56.775+0000 7f86ec727ec0 -1 Falling back to public interface 2020-02-08T18:28:57.553 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:57.548+0000 7f86ec727ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-08T18:28:57.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:57.720 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:57.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:28:57.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:57.721 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:57.721 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:28:58.023 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:28:59.024 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:28:59.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:28:59.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:28:59.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:28:59.025 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:28:59.025 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:28:59.277 INFO:tasks.workunit.client.0.smithi157.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/109359,v1:127.0.0.1:6803/109359] [v2:127.0.0.1:6804/109359,v1:127.0.0.1:6805/109359] exists,up abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:28:59.277 INFO:tasks.workunit.client.0.smithi157.stdout:add osd1 fa5ea5f1-9e33-468b-baad-6cf5720c4997 2020-02-08T18:28:59.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:28:59.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:28:59.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:28:59.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: TEST_auto_repair_bluestore_basic: for id in $(seq 0 2) 2020-02-08T18:28:59.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: TEST_auto_repair_bluestore_basic: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:28:59.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-repair 2020-02-08T18:28:59.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:28:59.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=1 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-repair/1 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:28:59.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2020-02-08T18:28:59.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2020-02-08T18:28:59.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:28:59.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:28:59.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:28:59.281 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:28:59.281 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:28:59.281 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:28:59.281 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:28:59.281 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:28:59.281 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:28:59.282 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:59.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:28:59.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:28:59.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:28:59.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:28:59.282 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:28:59.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:28:59.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:28:59.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:28:59.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:28:59.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:28:59.283 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:28:59.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-repair/1 2020-02-08T18:28:59.284 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:28:59.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=fa5ea5f1-9e33-468b-baad-6cf5720c4997 2020-02-08T18:28:59.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd1 fa5ea5f1-9e33-468b-baad-6cf5720c4997' 2020-02-08T18:28:59.284 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:28:59.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQDr/T5e7EknERAA8cSAr1g6uFdFu4985BSwoQ== 2020-02-08T18:28:59.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQDr/T5e7EknERAA8cSAr1g6uFdFu4985BSwoQ=="}' 2020-02-08T18:28:59.291 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new fa5ea5f1-9e33-468b-baad-6cf5720c4997 -i td/osd-scrub-repair/1/new.json 2020-02-08T18:28:59.648 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:28:59.658 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-repair/1/new.json 2020-02-08T18:28:59.660 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 1 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDr/T5e7EknERAA8cSAr1g6uFdFu4985BSwoQ== --osd-uuid fa5ea5f1-9e33-468b-baad-6cf5720c4997 2020-02-08T18:28:59.683 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.681+0000 7fc28d7ebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:59.685 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.683+0000 7fc28d7ebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:59.686 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.684+0000 7fc28d7ebec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:28:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.685+0000 7fc28d7ebec0 -1 bluestore(td/osd-scrub-repair/1/block) _read_bdev_label failed to open td/osd-scrub-repair/1/block: (2) No such file or directory 2020-02-08T18:28:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.685+0000 7fc28d7ebec0 -1 bluestore(td/osd-scrub-repair/1/block) _read_bdev_label failed to open td/osd-scrub-repair/1/block: (2) No such file or directory 2020-02-08T18:28:59.687 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.685+0000 7fc28d7ebec0 -1 bluestore(td/osd-scrub-repair/1/block) _read_bdev_label failed to open td/osd-scrub-repair/1/block: (2) No such file or directory 2020-02-08T18:28:59.749 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:28:59.747+0000 7fc28d7ebec0 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2020-02-08T18:29:02.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2020-02-08T18:29:02.816 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:29:02.817 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd1 key to auth repository 2020-02-08T18:29:02.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd1 key to auth repository 2020-02-08T18:29:02.817 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:29:03.118 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.1 2020-02-08T18:29:03.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.1 2020-02-08T18:29:03.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 1 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:03.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:29:03.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:29:03.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:29:03.140 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:03.138+0000 7fd1a4f4dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:03.142 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:03.140+0000 7fd1a4f4dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:03.143 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:03.141+0000 7fd1a4f4dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:03.359 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 1 2020-02-08T18:29:03.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:29:03.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=1 2020-02-08T18:29:03.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:29:03.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:29:03.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:03.360 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:29:03.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:03.361 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:29:03.361 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:29:03.598 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:03.662 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:03.660+0000 7fd1a4f4dec0 -1 Falling back to public interface 2020-02-08T18:29:04.363 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:04.361+0000 7fd1a4f4dec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-08T18:29:04.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:04.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:04.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:29:04.600 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:29:04.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:04.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:29:04.853 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:05.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:05.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:05.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:29:05.855 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:05.855 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:29:05.856 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.1 up' 2020-02-08T18:29:06.107 INFO:tasks.workunit.client.0.smithi157.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/109736,v1:127.0.0.1:6811/109736] [v2:127.0.0.1:6812/109736,v1:127.0.0.1:6813/109736] exists,up fa5ea5f1-9e33-468b-baad-6cf5720c4997 2020-02-08T18:29:06.107 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: TEST_auto_repair_bluestore_basic: for id in $(seq 0 2) 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: TEST_auto_repair_bluestore_basic: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-repair 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=2 2020-02-08T18:29:06.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-repair/2 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2020-02-08T18:29:06.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:06.110 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:29:06.118 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:29:06.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:29:06.119 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:29:06.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:29:06.121 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:29:06.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:29:06.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:29:06.122 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-repair/2 2020-02-08T18:29:06.122 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:29:06.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=595daff6-85ed-4154-bcb4-d091e0285f63 2020-02-08T18:29:06.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd2 595daff6-85ed-4154-bcb4-d091e0285f63' 2020-02-08T18:29:06.123 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:29:06.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQDy/T5eSnsiBxAAZNfhleJMPYQvncDOYf8DMQ== 2020-02-08T18:29:06.123 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQDy/T5eSnsiBxAAZNfhleJMPYQvncDOYf8DMQ=="}' 2020-02-08T18:29:06.124 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new 595daff6-85ed-4154-bcb4-d091e0285f63 -i td/osd-scrub-repair/2/new.json 2020-02-08T18:29:06.124 INFO:tasks.workunit.client.0.smithi157.stdout:add osd2 595daff6-85ed-4154-bcb4-d091e0285f63 2020-02-08T18:29:06.462 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:29:06.472 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-repair/2/new.json 2020-02-08T18:29:06.473 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 2 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDy/T5eSnsiBxAAZNfhleJMPYQvncDOYf8DMQ== --osd-uuid 595daff6-85ed-4154-bcb4-d091e0285f63 2020-02-08T18:29:06.497 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.495+0000 7f0cac0e9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:06.498 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.497+0000 7f0cac0e9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:06.500 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.498+0000 7f0cac0e9ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:06.500 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.498+0000 7f0cac0e9ec0 -1 bluestore(td/osd-scrub-repair/2/block) _read_bdev_label failed to open td/osd-scrub-repair/2/block: (2) No such file or directory 2020-02-08T18:29:06.500 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.498+0000 7f0cac0e9ec0 -1 bluestore(td/osd-scrub-repair/2/block) _read_bdev_label failed to open td/osd-scrub-repair/2/block: (2) No such file or directory 2020-02-08T18:29:06.500 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.498+0000 7f0cac0e9ec0 -1 bluestore(td/osd-scrub-repair/2/block) _read_bdev_label failed to open td/osd-scrub-repair/2/block: (2) No such file or directory 2020-02-08T18:29:06.553 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:06.552+0000 7f0cac0e9ec0 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2020-02-08T18:29:09.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2020-02-08T18:29:09.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: cat 2020-02-08T18:29:09.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: echo adding osd2 key to auth repository 2020-02-08T18:29:09.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2020-02-08T18:29:09.898 INFO:tasks.workunit.client.0.smithi157.stdout:adding osd2 key to auth repository 2020-02-08T18:29:10.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo start osd.2 2020-02-08T18:29:10.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph-osd -i 2 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:10.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph osd dump --format=json 2020-02-08T18:29:10.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: jq '.flags_set[]' 2020-02-08T18:29:10.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: grep -q '"noup"' 2020-02-08T18:29:10.202 INFO:tasks.workunit.client.0.smithi157.stdout:start osd.2 2020-02-08T18:29:10.224 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:10.222+0000 7f9baed5aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:10.225 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:10.224+0000 7f9baed5aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:10.227 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:10.225+0000 7f9baed5aec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:10.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: wait_for_osd up 2 2020-02-08T18:29:10.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=2 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:10.444 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:29:10.445 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:29:10.704 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:10.742 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:10.740+0000 7f9baed5aec0 -1 Falling back to public interface 2020-02-08T18:29:11.486 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:11.485+0000 7f9baed5aec0 -1 osd.2 0 log_to_monitors {default=true} 2020-02-08T18:29:11.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:11.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:11.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:29:11.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:11.706 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:29:11.706 INFO:tasks.workunit.client.0.smithi157.stdout:1 2020-02-08T18:29:11.957 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:12.958 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:12.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:12.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 2 2020-02-08T18:29:12.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:12.959 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.2 up' 2020-02-08T18:29:12.959 INFO:tasks.workunit.client.0.smithi157.stdout:2 2020-02-08T18:29:13.198 INFO:tasks.workunit.client.0.smithi157.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/110113,v1:127.0.0.1:6819/110113] [v2:127.0.0.1:6820/110113,v1:127.0.0.1:6821/110113] exists,up 595daff6-85ed-4154-bcb4-d091e0285f63 2020-02-08T18:29:13.198 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:29:13.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:29:13.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:29:13.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:347: TEST_auto_repair_bluestore_basic: create_pool testpool 1 1 2020-02-08T18:29:13.199 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:539: create_pool: ceph osd pool create testpool 1 1 2020-02-08T18:29:13.612 INFO:tasks.workunit.client.0.smithi157.stderr:pool 'testpool' created 2020-02-08T18:29:13.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: sleep 1 2020-02-08T18:29:14.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:348: TEST_auto_repair_bluestore_basic: ceph osd pool set testpool size 2 2020-02-08T18:29:14.981 INFO:tasks.workunit.client.0.smithi157.stderr:set pool 1 size to 2 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:349: TEST_auto_repair_bluestore_basic: wait_for_clean 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:29:14.996 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:29:14.997 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:29:14.997 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:29:14.997 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:29:14.997 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:29:15.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:29:15.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:29:15.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:29:15.082 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:29:15.082 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:29:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:29:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:15.363 INFO:tasks.workunit.client.0.smithi157.stderr:2' 2020-02-08T18:29:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:29:15.364 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:15.364 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:29:15.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=21474836485 2020-02-08T18:29:15.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836485' 2020-02-08T18:29:15.475 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:15.476 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:29:15.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672963 2020-02-08T18:29:15.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836485 1-42949672963' 2020-02-08T18:29:15.586 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:15.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:29:15.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509442 2020-02-08T18:29:15.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-21474836485 1-42949672963 2-64424509442' 2020-02-08T18:29:15.696 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:15.697 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-21474836485 2020-02-08T18:29:15.697 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:15.698 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:29:15.698 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-21474836485 2020-02-08T18:29:15.698 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:15.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=21474836485 2020-02-08T18:29:15.699 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2020-02-08T18:29:15.700 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:15.700 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.0 seq 21474836485 2020-02-08T18:29:15.935 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836484 -lt 21474836485 2020-02-08T18:29:15.936 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:29:16.937 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:29:16.937 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:17.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 21474836485 -lt 21474836485 2020-02-08T18:29:17.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:17.212 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672963 2020-02-08T18:29:17.212 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:17.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:29:17.213 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672963 2020-02-08T18:29:17.213 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:17.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672963 2020-02-08T18:29:17.214 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2020-02-08T18:29:17.214 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:29:17.214 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.1 seq 42949672963 2020-02-08T18:29:17.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672964 -lt 42949672963 2020-02-08T18:29:17.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:17.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509442 2020-02-08T18:29:17.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:17.455 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:29:17.456 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509442 2020-02-08T18:29:17.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:17.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509442 2020-02-08T18:29:17.457 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509442' 2020-02-08T18:29:17.457 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:29:17.457 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.2 seq 64424509442 2020-02-08T18:29:17.693 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509442 -lt 64424509442 2020-02-08T18:29:17.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:29:17.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:17.694 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:17.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 1 == 0 2020-02-08T18:29:17.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:29:17.980 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:29:17.980 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:29:17.980 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:29:17.980 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:29:17.981 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:29:17.981 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:29:18.216 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=1 2020-02-08T18:29:18.216 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:29:18.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:18.217 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:18.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 1 = 1 2020-02-08T18:29:18.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:29:18.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:29:18.511 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:352: TEST_auto_repair_bluestore_basic: local payload=ABCDEF 2020-02-08T18:29:18.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:353: TEST_auto_repair_bluestore_basic: echo ABCDEF 2020-02-08T18:29:18.512 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:354: TEST_auto_repair_bluestore_basic: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2020-02-08T18:29:18.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2020-02-08T18:29:18.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1165: get_not_primary: local poolname=testpool 2020-02-08T18:29:18.555 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1166: get_not_primary: local objectname=SOMETHING 2020-02-08T18:29:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: get_primary testpool SOMETHING 2020-02-08T18:29:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_primary: local poolname=testpool 2020-02-08T18:29:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1133: get_primary: local objectname=SOMETHING 2020-02-08T18:29:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:18.556 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: get_primary: jq .acting_primary 2020-02-08T18:29:18.797 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local primary=1 2020-02-08T18:29:18.798 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1169: get_not_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:18.798 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-02-08T18:29:19.042 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2020-02-08T18:29:19.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: objectstore_tool: local dir=td/osd-scrub-repair 2020-02-08T18:29:19.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: objectstore_tool: shift 2020-02-08T18:29:19.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local id=0 2020-02-08T18:29:19.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2020-02-08T18:29:19.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2020-02-08T18:29:19.043 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1205: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1206: _objectstore_tool_nowait: shift 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local id=0 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:29:19.044 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:29:19.045 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:29:19.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:29:19.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2020-02-08T18:29:19.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1193: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2020-02-08T18:29:19.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1194: _objectstore_tool_nodown: shift 2020-02-08T18:29:19.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local id=0 2020-02-08T18:29:19.148 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-02-08T18:29:19.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:19.149 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2020-02-08T18:29:19.918 INFO:tasks.workunit.client.0.smithi157.stdout:remove #1:eb822e21:::SOMETHING:head# 2020-02-08T18:29:20.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:20.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:842: activate_osd: local dir=td/osd-scrub-repair 2020-02-08T18:29:20.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: shift 2020-02-08T18:29:20.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local id=0 2020-02-08T18:29:20.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-02-08T18:29:20.437 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:29:20.438 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --chdir=' 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+= 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: get_asok_path 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:20.439 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:29:20.440 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:29:20.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' ' 2020-02-08T18:29:20.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:29:20.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:29:20.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: echo start osd.0 2020-02-08T18:29:20.441 INFO:tasks.workunit.client.0.smithi157.stderr:start osd.0 2020-02-08T18:29:20.441 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:20.442 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: cat td/osd-scrub-repair/0/whoami 2020-02-08T18:29:20.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: '[' 0 = 0 ']' 2020-02-08T18:29:20.442 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph osd dump --format=json 2020-02-08T18:29:20.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: jq '.flags_set[]' 2020-02-08T18:29:20.443 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: grep -q '"noup"' 2020-02-08T18:29:20.460 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:20.457+0000 7fe70c084ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:20.461 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:20.459+0000 7fe70c084ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:20.462 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:20.460+0000 7fe70c084ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:20.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: wait_for_osd up 0 2020-02-08T18:29:20.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:29:20.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:29:20.689 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:29:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:29:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:29:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:0 2020-02-08T18:29:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:20.690 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:29:20.924 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:20.978 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:20.976+0000 7fe70c084ec0 -1 Falling back to public interface 2020-02-08T18:29:21.828 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:21.826+0000 7fe70c084ec0 -1 osd.0 21 log_to_monitors {default=true} 2020-02-08T18:29:21.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:21.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:21.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:29:21.927 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:21.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:21.927 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:29:22.201 INFO:tasks.workunit.client.0.smithi157.stderr:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 22 last_clean_interval [5,21) [v2:127.0.0.1:6802/110954,v1:127.0.0.1:6803/110954] [v2:127.0.0.1:6804/110954,v1:127.0.0.1:6805/110954] exists,up abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:29:22.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:29:22.201 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: objectstore_tool: wait_for_clean 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:29:22.202 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:29:22.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:29:22.203 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:29:22.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:29:22.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:29:22.203 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:29:22.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:29:22.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:29:22.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:29:22.294 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:29:22.294 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:29:22.535 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:29:22.535 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:22.535 INFO:tasks.workunit.client.0.smithi157.stderr:2' 2020-02-08T18:29:22.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:29:22.536 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:22.536 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:29:22.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=103079215106 2020-02-08T18:29:22.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-103079215106' 2020-02-08T18:29:22.645 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:22.645 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:29:22.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672966 2020-02-08T18:29:22.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-103079215106 1-42949672966' 2020-02-08T18:29:22.756 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:22.756 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:29:22.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509445 2020-02-08T18:29:22.885 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-103079215106 1-42949672966 2-64424509445' 2020-02-08T18:29:22.886 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:22.886 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-103079215106 2020-02-08T18:29:22.886 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:22.887 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:29:22.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-103079215106 2020-02-08T18:29:22.887 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:22.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=103079215106 2020-02-08T18:29:22.889 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2020-02-08T18:29:22.889 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.0 seq 103079215106 2020-02-08T18:29:22.889 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:23.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 1 -lt 103079215106 2020-02-08T18:29:23.127 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:29:24.128 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:29:24.129 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:24.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 103079215106 -lt 103079215106 2020-02-08T18:29:24.378 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:24.378 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672966 2020-02-08T18:29:24.378 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:24.379 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:29:24.379 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672966 2020-02-08T18:29:24.379 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:24.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672966 2020-02-08T18:29:24.380 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2020-02-08T18:29:24.381 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.1 seq 42949672966 2020-02-08T18:29:24.381 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:29:24.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672966 -lt 42949672966 2020-02-08T18:29:24.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:24.621 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509445 2020-02-08T18:29:24.621 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:24.622 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:29:24.622 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509445 2020-02-08T18:29:24.623 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:24.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509445 2020-02-08T18:29:24.623 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509445' 2020-02-08T18:29:24.623 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.2 seq 64424509445 2020-02-08T18:29:24.624 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:29:24.861 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509445 -lt 64424509445 2020-02-08T18:29:24.862 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:29:24.862 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:24.863 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:25.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 1 == 0 2020-02-08T18:29:25.150 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:29:25.150 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:29:25.150 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:29:25.150 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:29:25.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:29:25.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:29:25.151 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:29:25.386 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=1 2020-02-08T18:29:25.386 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:29:25.387 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:25.387 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:25.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 1 = 1 2020-02-08T18:29:25.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:29:25.670 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:29:25.670 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:360: TEST_auto_repair_bluestore_basic: get_pg testpool SOMETHING 2020-02-08T18:29:25.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1029: get_pg: local poolname=testpool 2020-02-08T18:29:25.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1030: get_pg: local objectname=SOMETHING 2020-02-08T18:29:25.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:25.671 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: jq -r .pgid 2020-02-08T18:29:25.910 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:360: TEST_auto_repair_bluestore_basic: local pgid=1.0 2020-02-08T18:29:25.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:361: TEST_auto_repair_bluestore_basic: get_primary testpool SOMETHING 2020-02-08T18:29:25.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_primary: local poolname=testpool 2020-02-08T18:29:25.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1133: get_primary: local objectname=SOMETHING 2020-02-08T18:29:25.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:25.911 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: get_primary: jq .acting_primary 2020-02-08T18:29:26.170 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:361: TEST_auto_repair_bluestore_basic: local primary=1 2020-02-08T18:29:26.171 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:362: TEST_auto_repair_bluestore_basic: get_last_scrub_stamp 1.0 2020-02-08T18:29:26.171 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:26.171 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:26.171 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:26.171 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:26.405 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:362: TEST_auto_repair_bluestore_basic: local last_scrub_stamp=2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:26.406 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: TEST_auto_repair_bluestore_basic: ceph tell 1.0 deep_scrub 2020-02-08T18:29:26.507 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:29:26.507 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": true, 2020-02-08T18:29:26.507 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:27:46.506246+0000" 2020-02-08T18:29:26.507 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:29:26.515 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:364: TEST_auto_repair_bluestore_basic: ceph tell 1.0 scrub 2020-02-08T18:29:26.620 INFO:tasks.workunit.client.0.smithi157.stdout:{ 2020-02-08T18:29:26.620 INFO:tasks.workunit.client.0.smithi157.stdout: "deep": false, 2020-02-08T18:29:26.621 INFO:tasks.workunit.client.0.smithi157.stdout: "stamp": "2020-02-01T18:27:46.619397+0000" 2020-02-08T18:29:26.621 INFO:tasks.workunit.client.0.smithi157.stdout:} 2020-02-08T18:29:26.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:367: TEST_auto_repair_bluestore_basic: wait_for_scrub 1.0 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:26.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1877: wait_for_scrub: local pgid=1.0 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1878: wait_for_scrub: local last_scrub=2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local sname=last_scrub_stamp 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i=0 )) 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:26.630 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:26.631 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:26.631 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:26.862 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:29:13.495829+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:26.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:27.863 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:27.864 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:27.864 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:27.865 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:27.865 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:27.865 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:27.865 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:28.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:29:13.495829+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:28.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:29.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:29.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:29.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:29.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:29.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:29.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:29.110 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:29.353 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:29:13.495829+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:29.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:30.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:30.354 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:30.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:30.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:30.355 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:30.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:30.356 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:30.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:29:13.495829+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:30.600 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:31.601 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:31.602 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:31.602 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:31.602 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:31.603 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:31.603 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:31.603 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:31.846 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:29:13.495829+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:31.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:32.847 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:32.848 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:32.848 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:32.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:32.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:32.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:32.849 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:33.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-01T18:27:46.619397+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:33.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:34.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:34.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:34.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:34.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:34.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:34.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:34.093 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:34.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-01T18:27:46.619397+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:34.338 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:35.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:35.339 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:35.340 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:35.340 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:35.340 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:35.340 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:35.340 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:35.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-01T18:27:46.619397+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:35.584 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: sleep 1 2020-02-08T18:29:36.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i++ )) 2020-02-08T18:29:36.585 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: (( i < 300 )) 2020-02-08T18:29:36.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2020-02-08T18:29:36.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1462: get_last_scrub_stamp: local pgid=1.0 2020-02-08T18:29:36.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1463: get_last_scrub_stamp: local sname=last_scrub_stamp 2020-02-08T18:29:36.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: ceph --format json pg dump pgs 2020-02-08T18:29:36.586 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2020-02-08T18:29:36.831 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1882: wait_for_scrub: test 2020-02-08T18:29:31.263405+0000 '>' 2020-02-08T18:29:13.495829+0000 2020-02-08T18:29:36.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: return 0 2020-02-08T18:29:36.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:368: TEST_auto_repair_bluestore_basic: wait_for_clean 2020-02-08T18:29:36.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:29:36.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:29:36.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:29:36.832 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:29:36.833 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:29:36.833 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:29:36.833 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:29:36.833 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:29:36.833 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:29:36.833 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:29:36.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:29:36.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:29:36.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:29:36.925 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:29:36.926 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:29:37.161 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:29:37.162 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:37.162 INFO:tasks.workunit.client.0.smithi157.stderr:2' 2020-02-08T18:29:37.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:29:37.162 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:37.162 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:29:37.272 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=103079215110 2020-02-08T18:29:37.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-103079215110' 2020-02-08T18:29:37.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:37.273 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:29:37.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672970 2020-02-08T18:29:37.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-103079215110 1-42949672970' 2020-02-08T18:29:37.382 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:37.383 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:29:37.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509448 2020-02-08T18:29:37.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-103079215110 1-42949672970 2-64424509448' 2020-02-08T18:29:37.493 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:37.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-103079215110 2020-02-08T18:29:37.494 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:37.495 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:29:37.495 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-103079215110 2020-02-08T18:29:37.495 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:37.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=103079215110 2020-02-08T18:29:37.496 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 103079215110' 2020-02-08T18:29:37.496 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:37.496 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.0 seq 103079215110 2020-02-08T18:29:37.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 103079215108 -lt 103079215110 2020-02-08T18:29:37.733 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:29:38.734 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:29:38.734 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:38.980 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 103079215110 -lt 103079215110 2020-02-08T18:29:38.981 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:38.981 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672970 2020-02-08T18:29:38.981 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:38.982 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:29:38.982 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672970 2020-02-08T18:29:38.982 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:38.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672970 2020-02-08T18:29:38.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2020-02-08T18:29:38.983 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.1 seq 42949672970 2020-02-08T18:29:38.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:29:39.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672970 -lt 42949672970 2020-02-08T18:29:39.224 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:39.225 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509448 2020-02-08T18:29:39.225 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:39.226 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:29:39.226 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509448 2020-02-08T18:29:39.226 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:39.227 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509448 2020-02-08T18:29:39.228 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2020-02-08T18:29:39.228 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:29:39.228 INFO:tasks.workunit.client.0.smithi157.stdout:waiting osd.2 seq 64424509448 2020-02-08T18:29:39.469 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509449 -lt 64424509448 2020-02-08T18:29:39.470 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:29:39.470 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:39.470 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:39.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 1 == 0 2020-02-08T18:29:39.757 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:29:39.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:29:39.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:29:39.757 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:29:39.758 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:29:39.758 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:29:39.758 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:29:39.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=1 2020-02-08T18:29:39.992 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:29:39.992 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:39.993 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:40.284 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 1 = 1 2020-02-08T18:29:40.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:29:40.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:29:40.289 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:369: TEST_auto_repair_bluestore_basic: ceph pg dump pgs 2020-02-08T18:29:40.508 INFO:tasks.workunit.client.0.smithi157.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN 2020-02-08T18:29:40.508 INFO:tasks.workunit.client.0.smithi157.stdout:1.0 1 0 0 0 0 7 0 0 1 1 active+clean 2020-02-08T18:29:31.491312+0000 21'1 25:49 [1,0] 1 [1,0] 1 21'1 2020-02-08T18:29:31.263405+0000 21'1 2020-02-08T18:29:31.263405+0000 0 2020-02-08T18:29:40.508 INFO:tasks.workunit.client.0.smithi157.stdout: 2020-02-08T18:29:40.508 INFO:tasks.workunit.client.0.smithi157.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/docs/master/dev/placement-group/#omap-statistics for further details. 2020-02-08T18:29:40.509 INFO:tasks.workunit.client.0.smithi157.stderr:dumped pgs 2020-02-08T18:29:40.518 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:372: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1165: get_not_primary: local poolname=testpool 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1166: get_not_primary: local objectname=SOMETHING 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: get_primary testpool SOMETHING 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_primary: local poolname=testpool 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1133: get_primary: local objectname=SOMETHING 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:40.519 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: get_primary: jq .acting_primary 2020-02-08T18:29:40.760 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local primary=1 2020-02-08T18:29:40.760 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1169: get_not_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:40.761 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-02-08T18:29:41.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:372: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2020-02-08T18:29:41.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: objectstore_tool: local dir=td/osd-scrub-repair 2020-02-08T18:29:41.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: objectstore_tool: shift 2020-02-08T18:29:41.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local id=0 2020-02-08T18:29:41.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2020-02-08T18:29:41.004 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1205: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1206: _objectstore_tool_nowait: shift 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local id=0 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:29:41.005 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:29:41.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:29:41.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:29:41.006 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:29:41.108 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:29:41.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2020-02-08T18:29:41.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1193: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2020-02-08T18:29:41.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1194: _objectstore_tool_nodown: shift 2020-02-08T18:29:41.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local id=0 2020-02-08T18:29:41.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-02-08T18:29:41.109 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:41.110 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2020-02-08T18:29:41.734 INFO:tasks.workunit.client.0.smithi157.stdout:_ 2020-02-08T18:29:41.735 INFO:tasks.workunit.client.0.smithi157.stdout:snapset 2020-02-08T18:29:42.255 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:842: activate_osd: local dir=td/osd-scrub-repair 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: shift 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local id=0 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:29:42.256 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --chdir=' 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+= 2020-02-08T18:29:42.257 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:29:42.258 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: get_asok_path 2020-02-08T18:29:42.259 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:42.259 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:42.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:42.259 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:42.260 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:42.260 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:42.260 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' ' 2020-02-08T18:29:42.261 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: echo start osd.0 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr:start osd.0 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: cat td/osd-scrub-repair/0/whoami 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: '[' 0 = 0 ']' 2020-02-08T18:29:42.262 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph osd dump --format=json 2020-02-08T18:29:42.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: jq '.flags_set[]' 2020-02-08T18:29:42.263 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: grep -q '"noup"' 2020-02-08T18:29:42.279 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:42.277+0000 7f33e7418ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:42.281 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:42.279+0000 7f33e7418ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:42.282 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:42.280+0000 7f33e7418ec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:42.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: wait_for_osd up 0 2020-02-08T18:29:42.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:29:42.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:29:42.506 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:29:42.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:29:42.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:42.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:29:42.507 INFO:tasks.workunit.client.0.smithi157.stderr:0 2020-02-08T18:29:42.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:42.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:29:42.749 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:42.800 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:42.799+0000 7f33e7418ec0 -1 Falling back to public interface 2020-02-08T18:29:43.599 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:43.598+0000 7f33e7418ec0 -1 osd.0 25 log_to_monitors {default=true} 2020-02-08T18:29:43.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:43.750 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:43.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:29:43.751 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:43.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:43.751 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:29:43.997 INFO:tasks.workunit.client.0.smithi157.stderr:osd.0 up in weight 1 up_from 28 up_thru 0 down_at 26 last_clean_interval [24,25) [v2:127.0.0.1:6802/112480,v1:127.0.0.1:6803/112480] [v2:127.0.0.1:6804/112480,v1:127.0.0.1:6805/112480] exists,up abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: objectstore_tool: wait_for_clean 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:29:43.998 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:29:43.999 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:29:44.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:29:44.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:29:44.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:29:44.091 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:29:44.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:29:44.329 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:29:44.330 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:44.330 INFO:tasks.workunit.client.0.smithi157.stderr:2' 2020-02-08T18:29:44.330 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:29:44.330 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:44.330 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:29:44.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=120259084290 2020-02-08T18:29:44.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-120259084290' 2020-02-08T18:29:44.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:44.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:29:44.562 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672972 2020-02-08T18:29:44.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-120259084290 1-42949672972' 2020-02-08T18:29:44.563 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:44.563 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:29:44.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509451 2020-02-08T18:29:44.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-120259084290 1-42949672972 2-64424509451' 2020-02-08T18:29:44.674 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:44.675 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-120259084290 2020-02-08T18:29:44.675 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:44.675 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:29:44.676 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-120259084290 2020-02-08T18:29:44.676 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:44.676 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=120259084290 2020-02-08T18:29:44.677 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 120259084290' 2020-02-08T18:29:44.677 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.0 seq 120259084290 2020-02-08T18:29:44.677 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:44.916 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 1 -lt 120259084290 2020-02-08T18:29:44.917 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:29:45.918 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:29:45.918 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:46.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 120259084290 -lt 120259084290 2020-02-08T18:29:46.165 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:46.166 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672972 2020-02-08T18:29:46.166 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:46.166 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:29:46.167 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672972 2020-02-08T18:29:46.167 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:46.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672972 2020-02-08T18:29:46.168 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2020-02-08T18:29:46.168 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.1 seq 42949672972 2020-02-08T18:29:46.168 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:29:46.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672973 -lt 42949672972 2020-02-08T18:29:46.432 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:46.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509451 2020-02-08T18:29:46.433 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:46.433 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:29:46.434 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509451 2020-02-08T18:29:46.434 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:46.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509451 2020-02-08T18:29:46.435 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509451' 2020-02-08T18:29:46.435 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.2 seq 64424509451 2020-02-08T18:29:46.435 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:29:46.673 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509451 -lt 64424509451 2020-02-08T18:29:46.673 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:29:46.674 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:46.674 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:46.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 1 == 0 2020-02-08T18:29:46.963 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:29:46.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:29:46.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:29:46.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:29:46.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:29:46.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:29:46.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:29:47.195 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=1 2020-02-08T18:29:47.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:29:47.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:47.196 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:47.490 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 1 = 1 2020-02-08T18:29:47.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:29:47.491 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:29:47.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:373: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2020-02-08T18:29:47.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1165: get_not_primary: local poolname=testpool 2020-02-08T18:29:47.493 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1166: get_not_primary: local objectname=SOMETHING 2020-02-08T18:29:47.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: get_primary testpool SOMETHING 2020-02-08T18:29:47.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_primary: local poolname=testpool 2020-02-08T18:29:47.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1133: get_primary: local objectname=SOMETHING 2020-02-08T18:29:47.494 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:47.495 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1136: get_primary: jq .acting_primary 2020-02-08T18:29:47.746 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local primary=1 2020-02-08T18:29:47.746 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1169: get_not_primary: ceph --format json osd map testpool SOMETHING 2020-02-08T18:29:47.746 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2020-02-08T18:29:47.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:373: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2020-02-08T18:29:47.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1233: objectstore_tool: local dir=td/osd-scrub-repair 2020-02-08T18:29:47.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1234: objectstore_tool: shift 2020-02-08T18:29:47.991 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local id=0 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1205: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1206: _objectstore_tool_nowait: shift 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local id=0 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2020-02-08T18:29:47.992 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2020-02-08T18:29:47.993 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:29:47.993 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:29:47.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:29:47.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:29:47.993 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:29:48.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:29:48.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2020-02-08T18:29:48.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1193: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2020-02-08T18:29:48.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1194: _objectstore_tool_nodown: shift 2020-02-08T18:29:48.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local id=0 2020-02-08T18:29:48.096 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2020-02-08T18:29:48.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:48.097 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1200: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2020-02-08T18:29:49.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1213: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:49.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:842: activate_osd: local dir=td/osd-scrub-repair 2020-02-08T18:29:49.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: shift 2020-02-08T18:29:49.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local id=0 2020-02-08T18:29:49.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2020-02-08T18:29:49.273 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:29:49.274 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --chdir=' 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+= 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: get_asok_path 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:49.275 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:49.276 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:49.276 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:49.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:49.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:29:49.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:29:49.276 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:29:49.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:29:49.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:29:49.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:29:49.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' ' 2020-02-08T18:29:49.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:29:49.277 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:29:49.278 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: echo start osd.0 2020-02-08T18:29:49.278 INFO:tasks.workunit.client.0.smithi157.stderr:start osd.0 2020-02-08T18:29:49.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:49.279 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: cat td/osd-scrub-repair/0/whoami 2020-02-08T18:29:49.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: '[' 0 = 0 ']' 2020-02-08T18:29:49.279 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph osd dump --format=json 2020-02-08T18:29:49.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: jq '.flags_set[]' 2020-02-08T18:29:49.280 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: grep -q '"noup"' 2020-02-08T18:29:49.297 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:49.295+0000 7f3fb584dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:49.299 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:49.297+0000 7f3fb584dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:49.300 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:49.299+0000 7f3fb584dec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:877: activate_osd: wait_for_osd up 0 2020-02-08T18:29:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:914: wait_for_osd: local state=up 2020-02-08T18:29:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:915: wait_for_osd: local id=0 2020-02-08T18:29:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: status=1 2020-02-08T18:29:49.523 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i=0 )) 2020-02-08T18:29:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 0 2020-02-08T18:29:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:0 2020-02-08T18:29:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:49.524 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:29:49.761 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: sleep 1 2020-02-08T18:29:49.816 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:49.815+0000 7f3fb584dec0 -1 Falling back to public interface 2020-02-08T18:29:50.613 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:50.612+0000 7f3fb584dec0 -1 osd.0 29 log_to_monitors {default=true} 2020-02-08T18:29:50.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i++ )) 2020-02-08T18:29:50.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:918: wait_for_osd: (( i < 300 )) 2020-02-08T18:29:50.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: echo 1 2020-02-08T18:29:50.762 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:50.762 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: ceph osd dump 2020-02-08T18:29:50.763 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: grep 'osd.0 up' 2020-02-08T18:29:51.061 INFO:tasks.workunit.client.0.smithi157.stderr:osd.0 up in weight 1 up_from 32 up_thru 0 down_at 30 last_clean_interval [28,29) [v2:127.0.0.1:6802/113195,v1:127.0.0.1:6803/113195] [v2:127.0.0.1:6804/113195,v1:127.0.0.1:6805/113195] exists,up abb81fb6-a6f6-4ecf-8011-f8d410eaa5eb 2020-02-08T18:29:51.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: status=0 2020-02-08T18:29:51.061 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:924: wait_for_osd: break 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:927: wait_for_osd: return 0 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1239: objectstore_tool: wait_for_clean 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1578: wait_for_clean: local cmd= 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: wait_for_clean: local num_active_clean=-1 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cur_active_clean 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2020-02-08T18:29:51.062 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: get_timeout_delays 90 .1 2020-02-08T18:29:51.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: shopt -q -o xtrace 2020-02-08T18:29:51.063 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: echo true 2020-02-08T18:29:51.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1524: get_timeout_delays: local trace=true 2020-02-08T18:29:51.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: true 2020-02-08T18:29:51.063 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1525: get_timeout_delays: shopt -u -o xtrace 2020-02-08T18:29:51.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local -a delays 2020-02-08T18:29:51.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local -i loop=0 2020-02-08T18:29:51.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: flush_pg_stats 2020-02-08T18:29:51.154 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: flush_pg_stats: local timeout=300 2020-02-08T18:29:51.154 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ceph osd ls 2020-02-08T18:29:51.391 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: ids='0 2020-02-08T18:29:51.391 INFO:tasks.workunit.client.0.smithi157.stderr:1 2020-02-08T18:29:51.391 INFO:tasks.workunit.client.0.smithi157.stderr:2' 2020-02-08T18:29:51.392 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: flush_pg_stats: seqs= 2020-02-08T18:29:51.392 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:51.392 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2020-02-08T18:29:51.501 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=137438953474 2020-02-08T18:29:51.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-137438953474' 2020-02-08T18:29:51.502 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:51.502 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2020-02-08T18:29:51.612 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=42949672975 2020-02-08T18:29:51.612 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-137438953474 1-42949672975' 2020-02-08T18:29:51.612 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: for osd in $ids 2020-02-08T18:29:51.612 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2020-02-08T18:29:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seq=64424509453 2020-02-08T18:29:51.722 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: seqs=' 0-137438953474 1-42949672975 2-64424509453' 2020-02-08T18:29:51.723 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:51.723 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 0-137438953474 2020-02-08T18:29:51.723 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:51.724 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=0 2020-02-08T18:29:51.724 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 0-137438953474 2020-02-08T18:29:51.724 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:51.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=137438953474 2020-02-08T18:29:51.725 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.0 seq 137438953474' 2020-02-08T18:29:51.725 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.0 seq 137438953474 2020-02-08T18:29:51.725 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:51.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 120259084290 -lt 137438953474 2020-02-08T18:29:51.962 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2079: flush_pg_stats: sleep 1 2020-02-08T18:29:52.964 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: '[' 300 -eq 0 ']' 2020-02-08T18:29:52.964 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 0 2020-02-08T18:29:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 137438953474 -lt 137438953474 2020-02-08T18:29:53.209 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:53.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 1-42949672975 2020-02-08T18:29:53.210 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:53.211 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=1 2020-02-08T18:29:53.211 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 1-42949672975 2020-02-08T18:29:53.211 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:53.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=42949672975 2020-02-08T18:29:53.212 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.1 seq 42949672975' 2020-02-08T18:29:53.212 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.1 seq 42949672975 2020-02-08T18:29:53.212 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 1 2020-02-08T18:29:53.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 42949672975 -lt 42949672975 2020-02-08T18:29:53.452 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2074: flush_pg_stats: for s in $seqs 2020-02-08T18:29:53.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: echo 2-64424509453 2020-02-08T18:29:53.452 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: cut -d - -f 1 2020-02-08T18:29:53.453 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: osd=2 2020-02-08T18:29:53.453 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: echo 2-64424509453 2020-02-08T18:29:53.454 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: cut -d - -f 2 2020-02-08T18:29:53.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2076: flush_pg_stats: seq=64424509453 2020-02-08T18:29:53.454 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: echo 'waiting osd.2 seq 64424509453' 2020-02-08T18:29:53.455 INFO:tasks.workunit.client.0.smithi157.stderr:waiting osd.2 seq 64424509453 2020-02-08T18:29:53.455 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: ceph osd last-stat-seq 2 2020-02-08T18:29:53.695 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2078: flush_pg_stats: test 64424509453 -lt 64424509453 2020-02-08T18:29:53.696 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: get_num_pgs 2020-02-08T18:29:53.696 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:53.696 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:53.983 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1585: wait_for_clean: test 1 == 0 2020-02-08T18:29:53.984 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1589: wait_for_clean: true 2020-02-08T18:29:53.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: get_num_active_clean 2020-02-08T18:29:53.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1300: get_num_active_clean: local expression 2020-02-08T18:29:53.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1301: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2020-02-08T18:29:53.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: expression+='select(contains("stale") | not)' 2020-02-08T18:29:53.984 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: ceph --format json pg dump pgs 2020-02-08T18:29:53.985 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2020-02-08T18:29:54.218 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: wait_for_clean: cur_active_clean=1 2020-02-08T18:29:54.218 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: get_num_pgs 2020-02-08T18:29:54.219 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: ceph --format json status 2020-02-08T18:29:54.219 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1361: get_num_pgs: jq .pgmap.num_pgs 2020-02-08T18:29:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: test 1 = 1 2020-02-08T18:29:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: wait_for_clean: break 2020-02-08T18:29:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: return 0 2020-02-08T18:29:54.504 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:374: TEST_auto_repair_bluestore_basic: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2020-02-08T18:29:54.505 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:375: TEST_auto_repair_bluestore_basic: grep scrub_finish td/osd-scrub-repair/osd.1.log 2020-02-08T18:29:54.507 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:29:31.262+0000 7fd183108700 20 osd.1 pg_epoch: 25 pg[1.0( v 21'1 (0'0,21'1] local-lis/les=24/25 n=1 ec=17/17 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=21'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair AUTO_REPAIR] scrub_finish 2020-02-08T18:29:54.507 INFO:tasks.workunit.client.0.smithi157.stdout:2020-02-08T18:29:31.262+0000 7fd183108700 20 osd.1 pg_epoch: 25 pg[1.0( v 21'1 (0'0,21'1] local-lis/les=24/25 n=1 ec=17/17 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=21'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair AUTO_REPAIR mbc={255={(1+0)=1}}] scrub_finish All may be fixed 2020-02-08T18:29:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:378: TEST_auto_repair_bluestore_basic: teardown td/osd-scrub-repair 2020-02-08T18:29:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-repair 2020-02-08T18:29:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:29:54.507 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-repair KILL 2020-02-08T18:29:54.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:29:54.508 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:29:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:29:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:29:54.508 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:29:54.614 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:29:54.614 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:29:54.615 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:29:54.615 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:29:54.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:29:54.616 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:29:54.616 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:29:54.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:29:54.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:29:54.618 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:29:54.618 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:29:54.619 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:29:54.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:29:54.620 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-repair 2020-02-08T18:29:54.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:29:54.626 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:54.627 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:54.627 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.105831 2020-02-08T18:29:54.628 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: for func in $funcs 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: TEST_auto_repair_bluestore_failed td/osd-scrub-repair 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:437: TEST_auto_repair_bluestore_failed: local dir=td/osd-scrub-repair 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:438: TEST_auto_repair_bluestore_failed: local poolname=testpool 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:441: TEST_auto_repair_bluestore_failed: setup td/osd-scrub-repair 2020-02-08T18:29:54.629 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-scrub-repair 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-scrub-repair 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-scrub-repair 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-scrub-repair KILL 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2020-02-08T18:29:54.630 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2020-02-08T18:29:54.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2020-02-08T18:29:54.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2020-02-08T18:29:54.631 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2020-02-08T18:29:54.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2020-02-08T18:29:54.632 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2020-02-08T18:29:54.632 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2020-02-08T18:29:54.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2020-02-08T18:29:54.633 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2020-02-08T18:29:54.633 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2020-02-08T18:29:54.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:29:54.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2020-02-08T18:29:54.634 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2020-02-08T18:29:54.635 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-08T18:29:54.635 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2020-02-08T18:29:54.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2020-02-08T18:29:54.636 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-scrub-repair 2020-02-08T18:29:54.637 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2020-02-08T18:29:54.637 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:54.637 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:54.637 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.105831 2020-02-08T18:29:54.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2020-02-08T18:29:54.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2020-02-08T18:29:54.638 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-scrub-repair 2020-02-08T18:29:54.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2020-02-08T18:29:54.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:54.639 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:54.639 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.105831 2020-02-08T18:29:54.641 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2020-02-08T18:29:54.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2020-02-08T18:29:54.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2020-02-08T18:29:54.641 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:442: TEST_auto_repair_bluestore_failed: run_mon td/osd-scrub-repair a 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-scrub-repair 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-scrub-repair/a 2020-02-08T18:29:54.642 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2020-02-08T18:29:54.931 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2020-02-08T18:29:54.931 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:54.932 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:54.932 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:54.932 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:54.932 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:54.932 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:54.933 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 2020-02-08T18:29:55.090 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: cat 2020-02-08T18:29:55.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a fsid 2020-02-08T18:29:55.091 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:29:55.092 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:29:55.092 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=fsid 2020-02-08T18:29:55.092 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .fsid 2020-02-08T18:29:55.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:29:55.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:29:55.092 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:29:55.093 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:29:55.093 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:55.093 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:55.094 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.105831/ceph-mon.a.asok 2020-02-08T18:29:55.094 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:29:55.094 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.105831/ceph-mon.a.asok config get fsid 2020-02-08T18:29:55.178 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:485: run_mon: get_config mon a mon_host 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1061: get_config: local daemon=mon 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1062: get_config: local id=a 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local config=mon_host 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1068: get_config: jq -r .mon_host 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: get_asok_path mon.a 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2020-02-08T18:29:55.179 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2020-02-08T18:29:55.180 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2020-02-08T18:29:55.180 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:55.180 INFO:tasks.workunit.client.0.smithi157.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:55.180 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.105831/ceph-mon.a.asok 2020-02-08T18:29:55.181 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: CEPH_ARGS= 2020-02-08T18:29:55.181 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: ceph --format json daemon /tmp/ceph-asok.105831/ceph-mon.a.asok config get mon_host 2020-02-08T18:29:55.265 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:443: TEST_auto_repair_bluestore_failed: run_mgr td/osd-scrub-repair x 2020-02-08T18:29:55.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:551: run_mgr: local dir=td/osd-scrub-repair 2020-02-08T18:29:55.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: shift 2020-02-08T18:29:55.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local id=x 2020-02-08T18:29:55.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2020-02-08T18:29:55.266 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local data=td/osd-scrub-repair/x 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: get_asok_path 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:55.267 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:55.268 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:29:55.268 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2020-02-08T18:29:55.890 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:446: TEST_auto_repair_bluestore_failed: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:29:55.891 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:447: TEST_auto_repair_bluestore_failed: seq 0 2 2020-02-08T18:29:55.892 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:447: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2020-02-08T18:29:55.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:448: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2020-02-08T18:29:55.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local dir=td/osd-scrub-repair 2020-02-08T18:29:55.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: shift 2020-02-08T18:29:55.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local id=0 2020-02-08T18:29:55.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2020-02-08T18:29:55.893 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local osd_data=td/osd-scrub-repair/0 2020-02-08T18:29:55.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local 'ceph_args=--fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2020-02-08T18:29:55.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2020-02-08T18:29:55.894 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --osd-journal-size=100' 2020-02-08T18:29:55.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2020-02-08T18:29:55.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2020-02-08T18:29:55.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2020-02-08T18:29:55.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --chdir=' 2020-02-08T18:29:55.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+= 2020-02-08T18:29:55.897 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: get_asok_path 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.105831 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:55.898 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --debug-osd=20' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --debug-ms=1' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-monc=20' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2020-02-08T18:29:55.899 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' ' 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: mkdir -p td/osd-scrub-repair/0 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: uuidgen 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: local uuid=bc47f4f9-438c-4c0d-af0c-2c0e0e20e776 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: echo 'add osd0 bc47f4f9-438c-4c0d-af0c-2c0e0e20e776' 2020-02-08T18:29:55.900 INFO:tasks.workunit.client.0.smithi157.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: ceph-authtool --gen-print-key 2020-02-08T18:29:55.901 INFO:tasks.workunit.client.0.smithi157.stdout:add osd0 bc47f4f9-438c-4c0d-af0c-2c0e0e20e776 2020-02-08T18:29:55.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: OSD_SECRET=AQAj/j5e1bCQNhAAEgl2Zlfu/l5amcD0F+nWbg== 2020-02-08T18:29:55.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo '{"cephx_secret": "AQAj/j5e1bCQNhAAEgl2Zlfu/l5amcD0F+nWbg=="}' 2020-02-08T18:29:55.926 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph osd new bc47f4f9-438c-4c0d-af0c-2c0e0e20e776 -i td/osd-scrub-repair/0/new.json 2020-02-08T18:29:56.183 INFO:tasks.workunit.client.0.smithi157.stdout:0 2020-02-08T18:29:56.191 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: rm td/osd-scrub-repair/0/new.json 2020-02-08T18:29:56.192 INFO:tasks.workunit.client.0.smithi157.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-osd -i 0 --fsid=540b4d66-568a-43c4-bd2f-4ebef077c0e7 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.105831/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAj/j5e1bCQNhAAEgl2Zlfu/l5amcD0F+nWbg== --osd-uuid bc47f4f9-438c-4c0d-af0c-2c0e0e20e776 2020-02-08T18:29:56.216 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.214+0000 7f7b68e2bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:56.218 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.216+0000 7f7b68e2bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:56.219 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.217+0000 7f7b68e2bec0 -1 WARNING: all dangerous and experimental features are enabled. 2020-02-08T18:29:56.219 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.218+0000 7f7b68e2bec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:29:56.219 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.218+0000 7f7b68e2bec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:29:56.219 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.218+0000 7f7b68e2bec0 -1 bluestore(td/osd-scrub-repair/0/block) _read_bdev_label failed to open td/osd-scrub-repair/0/block: (2) No such file or directory 2020-02-08T18:29:56.272 INFO:tasks.workunit.client.0.smithi157.stderr:2020-02-08T18:29:56.271+0000 7f7b68e2bec0 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2020-02-08T18:29:57.297 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-02-08T18:29:57.298 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2020-02-08T18:29:57.298 DEBUG:teuthology.task.console_log:Killing console logger for smithi157 2020-02-08T18:29:57.298 DEBUG:teuthology.exit:Finished running handlers